![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9256 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8960 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2986 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29305 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30089 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4683 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9256 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins6424201896940521930.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 17:09:57 + trial_dir_prefix=trial- + rm -rf trial-2391 trial-2391-bin.tgz trial-2391-run.tgz + trial_dir=trial-2392 + mkdir -p trial-2392 + mv open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2392 + cat open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2986.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29305.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30089.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2392 combinations: None trial: 'trial-2392' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2392 -------------------------------------------------------------------------------------------- 17:10:08.380279 tst trial-2392: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/log --------------------------------------------------------------------- trial-2392 nitb_sms:sysmo --------------------------------------------------------------------- 17:12:15.425993 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:15.429458 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:15.450039 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:15.456709 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:15.510256 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:15.532439 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:15.540017 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:16.091525 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:16.099637 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 17:12:16.112102 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 17:12:16.501898 tst mo_mt_sms.py: using LAC 35047 17:12:16.783338 tst mo_mt_sms.py: using RAC 112 17:12:16.900459 tst mo_mt_sms.py: using CellId 35047 17:12:17.073346 tst mo_mt_sms.py: using BVCI 35048 17:12:17.183265 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:17.365408 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:17.486336 tst mo_mt_sms.py:9: start nitb and bts... 17:12:17.705712 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:20.045461 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9310): Launched 17:12:20.371714 run osmo-nitb_10.42.42.2(pid=9311): Launched 17:12:20.548781 run osmo-nitb_10.42.42.2(pid=9311): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9311)] 17:12:20.682131 run osmo-nitb_10.42.42.2(pid=9311): stdout: | (launched: 2022-12-13_17:12:20.310588) 17:12:20.816532 run osmo-nitb_10.42.42.2(pid=9311): stderr: | (launched: 2022-12-13_17:12:20.359099) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:20.951334 run osmo-nitb_10.42.42.2(pid=9311): stdout: | (launched: 2022-12-13_17:12:20.310588) 17:12:21.080306 run osmo-nitb_10.42.42.2(pid=9311): stderr: | (launched: 2022-12-13_17:12:20.359099) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:21.234893 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9311) [trial-2392↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9311)] [trial-2392↪nitb_sms:sysmo↪mo_mt_sms.py:11] 17:12:21.243718 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 17:12:21.250816 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9310): Terminating (SIGTERM) 17:12:21.462518 --- ParallelTerminationStrategy: PID 9310 died... 17:12:21.484748 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9310): Terminated: ok {rc=0} 17:12:21.574965 bus /sierra_3: Setting Powered False 17:12:22.676437 bus /sierra_3: Setting Powered False 17:12:23.793970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:sysmo --------------------------------------------------------------------- 17:12:24.975685 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:24.980095 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:25.001303 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:25.028711 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:25.080670 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:25.101994 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:25.132387 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:25.679897 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:25.685158 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:25.696111 tst sms:sysmo: Using 1 x bts (candidates: 1) 17:12:25.731442 tst mo_mt_sms.py: using LAC 35048 17:12:25.858404 tst mo_mt_sms.py: using RAC 113 17:12:25.983528 tst mo_mt_sms.py: using CellId 35048 17:12:26.112190 tst mo_mt_sms.py: using BVCI 35049 17:12:26.224060 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.234834 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.245401 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.255841 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.266444 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.277373 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:26.392194 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:26.516297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:28.272380 run create_hlr_db(pid=9315): Launched 17:12:28.397165 bus /sierra_2: Setting Powered False 17:12:29.461468 run create_hlr_db(pid=9315): Terminated: ok {rc=0} 17:12:29.900507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9317): Launched 17:12:30.207637 run osmo-hlr_10.42.42.2(pid=9318): Launched 17:12:30.323386 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:32.954380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9320): Launched 17:12:33.281037 run osmo-stp_10.42.42.5(pid=9321): Launched 17:12:33.404602 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:38.803338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9323): Launched 17:12:39.127657 run osmo-msc_10.42.42.6(pid=9324): Launched 17:12:39.307190 run osmo-stp_10.42.42.5(pid=9321): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9321)] 17:12:39.443408 run osmo-stp_10.42.42.5(pid=9321): stdout: | (launched: 2022-12-13_17:12:33.220101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:39.580743 run osmo-stp_10.42.42.5(pid=9321): stderr: | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171233418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:39.717423 run osmo-stp_10.42.42.5(pid=9321): stdout: | (launched: 2022-12-13_17:12:33.220101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:39.846729 run osmo-stp_10.42.42.5(pid=9321): stderr: | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171233417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171233418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171233418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:40.001379 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9321): Process ended prematurely: osmo-stp_10.42.42.5(pid=9321) [trial-2392↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9321)] [trial-2392↪sms:sysmo↪mo_mt_sms.py:16] 17:12:40.010268 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 17:12:40.037849 run osmo-hlr_10.42.42.2(pid=9318): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9318)] 17:12:40.090268 run osmo-hlr_10.42.42.2(pid=9318): stdout: | (launched: 2022-12-13_17:12:30.149920) 17:12:40.143160 run osmo-hlr_10.42.42.2(pid=9318): stderr: | [0;m[1;31m20221213171230332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171230332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171230332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171230332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171230333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171230333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171230358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:40.217402 run osmo-msc_10.42.42.6(pid=9324): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9324)] 17:12:40.268533 run osmo-msc_10.42.42.6(pid=9324): stdout: | (launched: 2022-12-13_17:12:39.066871) 17:12:40.321934 run osmo-msc_10.42.42.6(pid=9324): stderr: | [0;m[38;5;43m20221213171239392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171239392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbda9195c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171239392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171239393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171239393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171239393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171239395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171239395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171239395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171239395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:40.375588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9317): Terminating (SIGTERM) 17:12:40.417958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9320): Terminating (SIGTERM) 17:12:40.461474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9323): Terminating (SIGTERM) 17:12:40.504762 --- ParallelTerminationStrategy: PID 9317 died... 17:12:40.525606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9317): Terminated: ok {rc=0} 17:12:40.573360 --- ParallelTerminationStrategy: PID 9320 died... 17:12:40.593695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9320): Terminated: ok {rc=0} 17:12:40.641145 --- ParallelTerminationStrategy: PID 9323 died... 17:12:40.661316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9323): Terminated: ok {rc=0} 17:12:40.751507 bus /sierra_3: Setting Powered False 17:12:41.852166 bus /sierra_3: Setting Powered False 17:12:42.972798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:sysmo --------------------------------------------------------------------- 17:12:44.189681 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:44.193889 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:44.214942 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:44.222277 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:44.258617 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:44.279250 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:44.285889 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:44.804270 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:44.809332 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 17:12:44.820055 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:44.854319 tst assert_extension.py: using LAC 35049 17:12:44.979535 tst assert_extension.py: using RAC 114 17:12:45.098753 tst assert_extension.py: using CellId 35049 17:12:45.217430 tst assert_extension.py: using BVCI 35050 17:12:45.326875 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:45.446371 tst assert_extension.py:10: start nitb and bts... 17:12:45.667006 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:46.338279 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9329): Launched 17:12:46.679936 run osmo-nitb_10.42.42.2(pid=9330): Launched 17:12:46.880368 run osmo-nitb_10.42.42.2(pid=9330): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9330)] 17:12:47.029816 run osmo-nitb_10.42.42.2(pid=9330): stdout: | (launched: 2022-12-13_17:12:46.617946) 17:12:47.180151 run osmo-nitb_10.42.42.2(pid=9330): stderr: | (launched: 2022-12-13_17:12:46.666581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:47.329325 run osmo-nitb_10.42.42.2(pid=9330): stdout: | (launched: 2022-12-13_17:12:46.617946) 17:12:47.470289 run osmo-nitb_10.42.42.2(pid=9330): stderr: | (launched: 2022-12-13_17:12:46.666581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9330): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9330) [trial-2392↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9330)] 17:12:47.823096 tst osmo-nitb_10.42.42.2(pid=9330): stdout: | (launched: 2022-12-13_17:12:46.617946) 17:12:47.955329 tst osmo-nitb_10.42.42.2(pid=9330): stderr: | (launched: 2022-12-13_17:12:46.666581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:48.110698 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9330): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9330) [trial-2392↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9330)] [trial-2392↪nitb_ussd:sysmo↪assert_extension.py:12] 17:12:48.119645 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:12:48.126910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9329): Terminating (SIGTERM) 17:12:48.339322 --- ParallelTerminationStrategy: PID 9329 died... 17:12:48.361315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9329): Terminated: ok {rc=0} 17:12:48.455162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:sysmo --------------------------------------------------------------------- 17:12:49.617669 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:49.621829 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:49.643399 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:49.670791 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:49.710344 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:49.731977 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:49.759164 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:50.284383 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:50.289380 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.299820 tst ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:50.333716 tst assert_extension.py: using LAC 35050 17:12:50.454467 tst assert_extension.py: using RAC 115 17:12:50.576516 tst assert_extension.py: using CellId 35050 17:12:50.697979 tst assert_extension.py: using BVCI 35051 17:12:50.810095 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.820578 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.831071 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.841473 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.851846 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.862686 tst ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:50.983783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:51.488631 run create_hlr_db(pid=9334): Launched 17:12:51.613578 bus /sierra_2: Setting Powered False 17:12:52.677278 run create_hlr_db(pid=9334): Terminated: ok {rc=0} 17:12:53.114368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9336): Launched 17:12:53.418565 run osmo-hlr_10.42.42.2(pid=9337): Launched 17:12:53.534435 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:54.107540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9339): Launched 17:12:54.412327 run osmo-stp_10.42.42.5(pid=9340): Launched 17:12:54.529275 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:55.078145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9342): Launched 17:12:55.382492 run osmo-msc_10.42.42.6(pid=9343): Launched 17:12:55.551502 run osmo-stp_10.42.42.5(pid=9340): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9340)] 17:12:55.679775 run osmo-stp_10.42.42.5(pid=9340): stdout: | (launched: 2022-12-13_17:12:54.354976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:55.808708 run osmo-stp_10.42.42.5(pid=9340): stderr: | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171254530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:55.935196 run osmo-stp_10.42.42.5(pid=9340): stdout: | (launched: 2022-12-13_17:12:54.354976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:56.055725 run osmo-stp_10.42.42.5(pid=9340): stderr: | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171254529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171254530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171254530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:56.200133 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9340): Process ended prematurely: osmo-stp_10.42.42.5(pid=9340) [trial-2392↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9340)] [trial-2392↪ussd:sysmo↪assert_extension.py:17] 17:12:56.208354 tst assert_extension.py:17: Test FAILED (5.9 sec) 17:12:56.234458 run osmo-hlr_10.42.42.2(pid=9337): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9337)] 17:12:56.282818 run osmo-hlr_10.42.42.2(pid=9337): stdout: | (launched: 2022-12-13_17:12:53.361033) 17:12:56.333066 run osmo-hlr_10.42.42.2(pid=9337): stderr: | [0;m[1;31m20221213171253538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171253538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171253538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171253538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171253538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171253539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171253569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171253580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171253581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171253581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:56.402855 run osmo-msc_10.42.42.6(pid=9343): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9343)] 17:12:56.451373 run osmo-msc_10.42.42.6(pid=9343): stdout: | (launched: 2022-12-13_17:12:55.324646) 17:12:56.501594 run osmo-msc_10.42.42.6(pid=9343): stderr: | [0;m[38;5;43m20221213171255599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171255599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f675fbc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171255599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171255599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171255599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171255599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171255601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:56.552228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9336): Terminating (SIGTERM) 17:12:56.592752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9339): Terminating (SIGTERM) 17:12:56.633301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9342): Terminating (SIGTERM) 17:12:56.673894 --- ParallelTerminationStrategy: PID 9336 died... 17:12:56.693267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9336): Terminated: ok {rc=0} 17:12:56.738342 --- ParallelTerminationStrategy: PID 9339 died... 17:12:56.757231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9339): Terminated: ok {rc=0} 17:12:56.801685 --- ParallelTerminationStrategy: PID 9342 died... 17:12:56.820468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9342): Terminated: ok {rc=0} 17:12:56.904915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:12:58.108802 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:58.116150 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:12:58.137672 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:12:58.166098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:12:58.218187 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:12:58.238881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:12:58.265374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:12:58.817454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:12:58.869768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:58.880770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:12:58.941378 tst mo_mt_call.py: using LAC 35051 17:12:59.077176 tst mo_mt_call.py: using RAC 116 17:12:59.199654 tst mo_mt_call.py: using CellId 35051 17:12:59.319690 tst mo_mt_call.py: using BVCI 35052 17:12:59.430626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.441765 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.452528 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.463449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.474276 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.485355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:12:59.601209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:12:59.722570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:00.235978 run create_hlr_db(pid=9348): Launched 17:13:00.362031 bus /sierra_2: Setting Powered False 17:13:01.439971 run create_hlr_db(pid=9348): Terminated: ok {rc=0} 17:13:01.966322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9350): Launched 17:13:02.295854 run osmo-hlr_10.42.42.2(pid=9351): Launched 17:13:02.414985 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:02.950421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9353): Launched 17:13:03.262397 run osmo-stp_10.42.42.5(pid=9354): Launched 17:13:03.380517 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:03.940450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9356): Launched 17:13:04.283800 run osmo-msc_10.42.42.6(pid=9357): Launched 17:13:04.456221 run osmo-stp_10.42.42.5(pid=9354): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9354)] 17:13:04.586809 run osmo-stp_10.42.42.5(pid=9354): stdout: | (launched: 2022-12-13_17:13:03.203693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:04.717690 run osmo-stp_10.42.42.5(pid=9354): stderr: | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171303379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:04.846247 run osmo-stp_10.42.42.5(pid=9354): stdout: | (launched: 2022-12-13_17:13:03.203693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:04.968556 run osmo-stp_10.42.42.5(pid=9354): stderr: | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171303378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171303379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171303381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:05.116239 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9354): Process ended prematurely: osmo-stp_10.42.42.5(pid=9354) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9354)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:13:05.125059 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:13:05.151380 run osmo-hlr_10.42.42.2(pid=9351): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9351)] 17:13:05.199757 run osmo-hlr_10.42.42.2(pid=9351): stdout: | (launched: 2022-12-13_17:13:02.237220) 17:13:05.249644 run osmo-hlr_10.42.42.2(pid=9351): stderr: | [0;m[1;31m20221213171302417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171302417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171302418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171302418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171302418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171302418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171302437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171302446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171302446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171302446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:05.318977 run osmo-msc_10.42.42.6(pid=9357): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9357)] 17:13:05.367068 run osmo-msc_10.42.42.6(pid=9357): stdout: | (launched: 2022-12-13_17:13:04.225466) 17:13:05.417052 run osmo-msc_10.42.42.6(pid=9357): stderr: | [0;m[38;5;43m20221213171304504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171304504 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6fe9faac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171304504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171304504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171304504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171304504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171304506 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171304506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171304507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171304507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:05.467261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9350): Terminating (SIGTERM) 17:13:05.507525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9353): Terminating (SIGTERM) 17:13:05.547740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9356): Terminating (SIGTERM) 17:13:05.588137 --- ParallelTerminationStrategy: PID 9350 died... 17:13:05.607557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9350): Terminated: ok {rc=0} 17:13:05.651765 --- ParallelTerminationStrategy: PID 9353 died... 17:13:05.670489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9353): Terminated: ok {rc=0} 17:13:05.714649 --- ParallelTerminationStrategy: PID 9356 died... 17:13:05.733476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9356): Terminated: ok {rc=0} 17:13:05.820162 bus /sierra_3: Setting Powered False 17:13:06.922186 bus /sierra_3: Setting Powered False 17:13:08.043569 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:13:09.196860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.209209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:09.267617 tst mo_mt_call_osmux.py: using LAC 35052 17:13:09.397151 tst mo_mt_call_osmux.py: using RAC 117 17:13:09.642529 tst mo_mt_call_osmux.py: using CellId 35052 17:13:09.792226 tst mo_mt_call_osmux.py: using BVCI 35053 17:13:09.904732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.916150 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.927257 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.938315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.949185 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.960025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:10.082205 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:10.200921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:10.682490 run create_hlr_db(pid=9359): Launched 17:13:10.808791 bus /sierra_2: Setting Powered False 17:13:11.870918 run create_hlr_db(pid=9359): Terminated: ok {rc=0} 17:13:12.327034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9361): Launched 17:13:12.661095 run osmo-hlr_10.42.42.2(pid=9362): Launched 17:13:12.787784 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:13.359464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9364): Launched 17:13:13.692711 run osmo-stp_10.42.42.5(pid=9365): Launched 17:13:13.818952 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:14.418639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9367): Launched 17:13:14.752831 run osmo-msc_10.42.42.6(pid=9368): Launched 17:13:14.937138 run osmo-stp_10.42.42.5(pid=9365): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9365)] 17:13:15.075866 run osmo-stp_10.42.42.5(pid=9365): stdout: | (launched: 2022-12-13_17:13:13.630772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:15.215202 run osmo-stp_10.42.42.5(pid=9365): stderr: | [0;m[38;5;43m20221213171313827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171313827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171313828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171313828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171313828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171313829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171313829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:15.354353 run osmo-stp_10.42.42.5(pid=9365): stdout: | (launched: 2022-12-13_17:13:13.630772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:15.485965 run osmo-stp_10.42.42.5(pid=9365): stderr: | [0;m[38;5;43m20221213171313827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171313827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171313828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171313828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171313828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171313829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171313829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:15.644227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9365): Process ended prematurely: osmo-stp_10.42.42.5(pid=9365) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9365)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:13:15.653784 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:13:15.681805 run osmo-hlr_10.42.42.2(pid=9362): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9362)] 17:13:15.734175 run osmo-hlr_10.42.42.2(pid=9362): stdout: | (launched: 2022-12-13_17:13:12.599010) 17:13:15.787620 run osmo-hlr_10.42.42.2(pid=9362): stderr: | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171312802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171312816 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171312824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171312824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171312824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:15.888206 run osmo-msc_10.42.42.6(pid=9368): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9368)] 17:13:15.947927 run osmo-msc_10.42.42.6(pid=9368): stdout: | (launched: 2022-12-13_17:13:14.690489) 17:13:16.003263 run osmo-msc_10.42.42.6(pid=9368): stderr: | [0;m[38;5;43m20221213171315017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171315017 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89dfa30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171315017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171315017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171315017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171315017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171315019 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171315019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171315020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171315020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:16.068188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9361): Terminating (SIGTERM) 17:13:16.126608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9364): Terminating (SIGTERM) 17:13:16.184046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9367): Terminating (SIGTERM) 17:13:16.240369 --- ParallelTerminationStrategy: PID 9361 died... 17:13:16.266182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9361): Terminated: ok {rc=0} 17:13:16.329423 --- ParallelTerminationStrategy: PID 9364 died... 17:13:16.349393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9364): Terminated: ok {rc=0} 17:13:16.397045 --- ParallelTerminationStrategy: PID 9367 died... 17:13:16.418074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9367): Terminated: ok {rc=0} 17:13:16.510990 bus /sierra_3: Setting Powered False 17:13:17.609230 bus /sierra_3: Setting Powered False 17:13:18.727058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:13:19.964333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:19.971251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:13:19.992889 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:13:20.021924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:13:20.075243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:13:20.096801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:13:20.124407 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:13:20.680074 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:13:20.733848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:20.745411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:20.802760 tst mo_mt_call.py: using LAC 35053 17:13:20.932286 tst mo_mt_call.py: using RAC 118 17:13:21.061289 tst mo_mt_call.py: using CellId 35053 17:13:21.190012 tst mo_mt_call.py: using BVCI 35054 17:13:21.312122 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.323875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.335300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.346776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.358646 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.370559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:21.489402 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:21.610675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:22.124317 run create_hlr_db(pid=9374): Launched 17:13:22.250155 bus /sierra_2: Setting Powered False 17:13:23.315218 run create_hlr_db(pid=9374): Terminated: ok {rc=0} 17:13:23.759741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9376): Launched 17:13:24.071755 run osmo-hlr_10.42.42.2(pid=9377): Launched 17:13:24.189334 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:24.723276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9379): Launched 17:13:25.035019 run osmo-stp_10.42.42.5(pid=9380): Launched 17:13:25.153748 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:25.715812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9382): Launched 17:13:26.027350 run osmo-msc_10.42.42.6(pid=9383): Launched 17:13:26.199946 run osmo-stp_10.42.42.5(pid=9380): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9380)] 17:13:26.330816 run osmo-stp_10.42.42.5(pid=9380): stdout: | (launched: 2022-12-13_17:13:24.975818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:26.461626 run osmo-stp_10.42.42.5(pid=9380): stderr: | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171325151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:26.589933 run osmo-stp_10.42.42.5(pid=9380): stdout: | (launched: 2022-12-13_17:13:24.975818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:26.712326 run osmo-stp_10.42.42.5(pid=9380): stderr: | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171325151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171325151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171325152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:26.859410 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9380): Process ended prematurely: osmo-stp_10.42.42.5(pid=9380) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9380)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:13:26.868187 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:13:26.894644 run osmo-hlr_10.42.42.2(pid=9377): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9377)] 17:13:26.943739 run osmo-hlr_10.42.42.2(pid=9377): stdout: | (launched: 2022-12-13_17:13:24.012807) 17:13:26.993731 run osmo-hlr_10.42.42.2(pid=9377): stderr: | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171324192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171324206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171324216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171324216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171324216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:27.063101 run osmo-msc_10.42.42.6(pid=9383): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9383)] 17:13:27.111142 run osmo-msc_10.42.42.6(pid=9383): stdout: | (launched: 2022-12-13_17:13:25.968814) 17:13:27.160910 run osmo-msc_10.42.42.6(pid=9383): stderr: | [0;m[38;5;43m20221213171326245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171326245 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff820b62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171326246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171326246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171326246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171326246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171326248 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171326248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171326248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171326248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:27.211199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9376): Terminating (SIGTERM) 17:13:27.251287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9379): Terminating (SIGTERM) 17:13:27.291163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9382): Terminating (SIGTERM) 17:13:27.331410 --- ParallelTerminationStrategy: PID 9376 died... 17:13:27.350636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9376): Terminated: ok {rc=0} 17:13:27.394961 --- ParallelTerminationStrategy: PID 9379 died... 17:13:27.413807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9379): Terminated: ok {rc=0} 17:13:27.457970 --- ParallelTerminationStrategy: PID 9382 died... 17:13:27.476787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9382): Terminated: ok {rc=0} 17:13:27.564239 bus /sierra_3: Setting Powered False 17:13:28.664158 bus /sierra_3: Setting Powered False 17:13:29.779389 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:13:30.959088 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:30.972668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:31.034266 tst mo_mt_call_osmux.py: using LAC 35054 17:13:31.167149 tst mo_mt_call_osmux.py: using RAC 119 17:13:31.290726 tst mo_mt_call_osmux.py: using CellId 35054 17:13:31.413314 tst mo_mt_call_osmux.py: using BVCI 35055 17:13:31.540086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.552619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.565236 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.577635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.591424 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.604794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:31.757305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:31.883664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:32.432030 run create_hlr_db(pid=9385): Launched 17:13:32.560040 bus /sierra_2: Setting Powered False 17:13:33.625772 run create_hlr_db(pid=9385): Terminated: ok {rc=0} 17:13:34.070855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Launched 17:13:34.385076 run osmo-hlr_10.42.42.2(pid=9388): Launched 17:13:34.503026 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:35.058293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Launched 17:13:35.370485 run osmo-stp_10.42.42.5(pid=9391): Launched 17:13:35.487223 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:36.052558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Launched 17:13:36.365216 run osmo-msc_10.42.42.6(pid=9394): Launched 17:13:36.538785 run osmo-stp_10.42.42.5(pid=9391): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] 17:13:36.669942 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-13_17:13:35.311582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:36.800203 run osmo-stp_10.42.42.5(pid=9391): stderr: | [0;m[38;5;43m20221213171335483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171335483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171335484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171335484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171335486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171335486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171335487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:36.929540 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-13_17:13:35.311582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:37.052148 run osmo-stp_10.42.42.5(pid=9391): stderr: | [0;m[38;5;43m20221213171335483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171335483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171335484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171335484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171335486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171335486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171335487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:37.199153 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:13:37.207885 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:13:37.234463 run osmo-hlr_10.42.42.2(pid=9388): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9388)] 17:13:37.282907 run osmo-hlr_10.42.42.2(pid=9388): stdout: | (launched: 2022-12-13_17:13:34.326084) 17:13:37.332752 run osmo-hlr_10.42.42.2(pid=9388): stderr: | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171334503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171334516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171334525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171334525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171334525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:37.402338 run osmo-msc_10.42.42.6(pid=9394): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9394)] 17:13:37.450516 run osmo-msc_10.42.42.6(pid=9394): stdout: | (launched: 2022-12-13_17:13:36.306295) 17:13:37.500505 run osmo-msc_10.42.42.6(pid=9394): stderr: | [0;m[38;5;43m20221213171336582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171336582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f18fe9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171336582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171336582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171336582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171336583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171336584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171336585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171336585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171336585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:37.550893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminating (SIGTERM) 17:13:37.591032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminating (SIGTERM) 17:13:37.631316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminating (SIGTERM) 17:13:37.671787 --- ParallelTerminationStrategy: PID 9387 died... 17:13:37.691174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminated: ok {rc=0} 17:13:37.735832 --- ParallelTerminationStrategy: PID 9390 died... 17:13:37.754790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminated: ok {rc=0} 17:13:37.799305 --- ParallelTerminationStrategy: PID 9393 died... 17:13:37.818242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminated: ok {rc=0} 17:13:37.905954 bus /sierra_3: Setting Powered False 17:13:39.008766 bus /sierra_3: Setting Powered False 17:13:40.128106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:13:41.367041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:41.373929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:13:41.395065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:13:41.422122 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:13:41.473547 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:13:41.494245 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:13:41.520725 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:13:42.073041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:13:42.123825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.135076 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:42.192147 tst mo_mt_call.py: using LAC 35055 17:13:42.315174 tst mo_mt_call.py: using RAC 120 17:13:42.439395 tst mo_mt_call.py: using CellId 35055 17:13:42.563819 tst mo_mt_call.py: using BVCI 35056 17:13:42.677904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.688932 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.699715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.710485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.721842 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.733252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:42.856542 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:42.977424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:43.494062 run create_hlr_db(pid=9400): Launched 17:13:43.621797 bus /sierra_2: Setting Powered False 17:13:44.687160 run create_hlr_db(pid=9400): Terminated: ok {rc=0} 17:13:45.149673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Launched 17:13:45.482615 run osmo-hlr_10.42.42.2(pid=9403): Launched 17:13:45.611747 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:46.195101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Launched 17:13:46.522928 run osmo-stp_10.42.42.5(pid=9406): Launched 17:13:46.821659 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:47.426052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Launched 17:13:47.739448 run osmo-msc_10.42.42.6(pid=9409): Launched 17:13:47.911713 run osmo-stp_10.42.42.5(pid=9406): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] 17:13:48.042898 run osmo-stp_10.42.42.5(pid=9406): stdout: | (launched: 2022-12-13_17:13:46.460278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:48.173169 run osmo-stp_10.42.42.5(pid=9406): stderr: | [0;m[38;5;43m20221213171346677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171346678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171346678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171346678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:48.302549 run osmo-stp_10.42.42.5(pid=9406): stdout: | (launched: 2022-12-13_17:13:46.460278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:48.425080 run osmo-stp_10.42.42.5(pid=9406): stderr: | [0;m[38;5;43m20221213171346677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171346678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171346678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171346678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171346681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:48.572371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9406): Process ended prematurely: osmo-stp_10.42.42.5(pid=9406) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:13:48.581344 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:13:48.607811 run osmo-hlr_10.42.42.2(pid=9403): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9403)] 17:13:48.655910 run osmo-hlr_10.42.42.2(pid=9403): stdout: | (launched: 2022-12-13_17:13:45.420415) 17:13:48.706000 run osmo-hlr_10.42.42.2(pid=9403): stderr: | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171345625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171345640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171345649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171345650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171345650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:48.789960 run osmo-msc_10.42.42.6(pid=9409): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9409)] 17:13:48.840835 run osmo-msc_10.42.42.6(pid=9409): stdout: | (launched: 2022-12-13_17:13:47.680052) 17:13:48.895177 run osmo-msc_10.42.42.6(pid=9409): stderr: | [0;m[38;5;43m20221213171347956 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171347956 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0254699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171347957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171347957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171347957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171347957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171347959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171347959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171347959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171347959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:48.949433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Terminating (SIGTERM) 17:13:48.989813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Terminating (SIGTERM) 17:13:49.030060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminating (SIGTERM) 17:13:49.070496 --- ParallelTerminationStrategy: PID 9402 died... 17:13:49.090003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Terminated: ok {rc=0} 17:13:49.134838 --- ParallelTerminationStrategy: PID 9405 died... 17:13:49.153859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Terminated: ok {rc=0} 17:13:49.198230 --- ParallelTerminationStrategy: PID 9408 died... 17:13:49.217354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminated: ok {rc=0} 17:13:49.304758 bus /sierra_3: Setting Powered False 17:13:50.405931 bus /sierra_3: Setting Powered False 17:13:51.525172 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:13:52.674102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:52.685948 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:52.741972 tst mo_mt_call_osmux.py: using LAC 35056 17:13:52.866874 tst mo_mt_call_osmux.py: using RAC 121 17:13:52.989039 tst mo_mt_call_osmux.py: using CellId 35056 17:13:53.108677 tst mo_mt_call_osmux.py: using BVCI 35057 17:13:53.221071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.232073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.242864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.253752 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.264514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.275352 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:53.393701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:53.516011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:53.998569 run create_hlr_db(pid=9411): Launched 17:13:54.124733 bus /sierra_2: Setting Powered False 17:13:55.186428 run create_hlr_db(pid=9411): Terminated: ok {rc=0} 17:13:55.642126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Launched 17:13:55.975717 run osmo-hlr_10.42.42.2(pid=9414): Launched 17:13:56.102430 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:56.676574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Launched 17:13:57.010060 run osmo-stp_10.42.42.5(pid=9417): Launched 17:13:57.136194 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:57.737365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Launched 17:13:58.071443 run osmo-msc_10.42.42.6(pid=9420): Launched 17:13:58.255479 run osmo-stp_10.42.42.5(pid=9417): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] 17:13:58.395489 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-13_17:13:56.947690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:58.536184 run osmo-stp_10.42.42.5(pid=9417): stderr: | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171357145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:58.676112 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-13_17:13:56.947690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:58.808143 run osmo-stp_10.42.42.5(pid=9417): stderr: | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171357144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171357145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171357145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:58.966506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:13:58.976282 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:13:59.004293 run osmo-hlr_10.42.42.2(pid=9414): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9414)] 17:13:59.056321 run osmo-hlr_10.42.42.2(pid=9414): stdout: | (launched: 2022-12-13_17:13:55.913831) 17:13:59.109485 run osmo-hlr_10.42.42.2(pid=9414): stderr: | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171356115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171356127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171356136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171356136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171356136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:59.183235 run osmo-msc_10.42.42.6(pid=9420): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9420)] 17:13:59.234264 run osmo-msc_10.42.42.6(pid=9420): stdout: | (launched: 2022-12-13_17:13:58.008809) 17:13:59.286910 run osmo-msc_10.42.42.6(pid=9420): stderr: | [0;m[38;5;43m20221213171358338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171358338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d8510cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171358338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171358338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171358338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171358339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171358340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171358341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171358341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171358341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:59.340153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminating (SIGTERM) 17:13:59.382431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminating (SIGTERM) 17:13:59.425344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Terminating (SIGTERM) 17:13:59.468025 --- ParallelTerminationStrategy: PID 9413 died... 17:13:59.488939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminated: ok {rc=0} 17:13:59.536360 --- ParallelTerminationStrategy: PID 9416 died... 17:13:59.556735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminated: ok {rc=0} 17:13:59.603807 --- ParallelTerminationStrategy: PID 9419 died... 17:13:59.623865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Terminated: ok {rc=0} 17:13:59.713913 bus /sierra_3: Setting Powered False 17:14:00.812931 bus /sierra_3: Setting Powered False 17:14:01.946632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:14:03.200939 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:03.207922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:14:03.229294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:14:03.257906 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:14:03.311355 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:14:03.333174 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:14:03.361115 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:14:03.909729 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:14:03.963704 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:03.975328 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:04.032896 tst mo_mt_call.py: using LAC 35057 17:14:04.170744 tst mo_mt_call.py: using RAC 122 17:14:04.313316 tst mo_mt_call.py: using CellId 35057 17:14:04.443212 tst mo_mt_call.py: using BVCI 35058 17:14:04.564332 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.576035 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.587551 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.599110 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.611001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.622958 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:04.740893 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:04.863958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:05.377582 run create_hlr_db(pid=9425): Launched 17:14:05.504102 bus /sierra_2: Setting Powered False 17:14:06.570131 run create_hlr_db(pid=9425): Terminated: ok {rc=0} 17:14:07.033148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Launched 17:14:07.365521 run osmo-hlr_10.42.42.2(pid=9428): Launched 17:14:07.492190 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:08.066315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Launched 17:14:08.399327 run osmo-stp_10.42.42.5(pid=9431): Launched 17:14:08.525821 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:09.126651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Launched 17:14:09.459971 run osmo-msc_10.42.42.6(pid=9434): Launched 17:14:09.645203 run osmo-stp_10.42.42.5(pid=9431): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] 17:14:09.785097 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-13_17:14:08.337351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:09.925895 run osmo-stp_10.42.42.5(pid=9431): stderr: | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171408533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:10.064666 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-13_17:14:08.337351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:10.196591 run osmo-stp_10.42.42.5(pid=9431): stderr: | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171408532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171408533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171408535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:10.354833 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:14:10.364540 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:14:10.392528 run osmo-hlr_10.42.42.2(pid=9428): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9428)] 17:14:10.444040 run osmo-hlr_10.42.42.2(pid=9428): stdout: | (launched: 2022-12-13_17:14:07.303553) 17:14:10.497175 run osmo-hlr_10.42.42.2(pid=9428): stderr: | [0;m[1;31m20221213171407506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171407507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171407507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171407507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171407507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171407507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171407520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171407530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171407530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171407530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:10.570589 run osmo-msc_10.42.42.6(pid=9434): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9434)] 17:14:10.621188 run osmo-msc_10.42.42.6(pid=9434): stdout: | (launched: 2022-12-13_17:14:09.397757) 17:14:10.674039 run osmo-msc_10.42.42.6(pid=9434): stderr: | [0;m[38;5;43m20221213171409724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171409725 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0fdafa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171409725 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171409725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171409725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171409725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171409727 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171409727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171409727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171409727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:10.726748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminating (SIGTERM) 17:14:10.769267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminating (SIGTERM) 17:14:10.812179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Terminating (SIGTERM) 17:14:10.855407 --- ParallelTerminationStrategy: PID 9427 died... 17:14:10.875816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminated: ok {rc=0} 17:14:10.922844 --- ParallelTerminationStrategy: PID 9430 died... 17:14:10.942879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminated: ok {rc=0} 17:14:10.989528 --- ParallelTerminationStrategy: PID 9433 died... 17:14:11.009397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9433): Terminated: ok {rc=0} 17:14:11.098874 bus /sierra_3: Setting Powered False 17:14:12.194603 bus /sierra_3: Setting Powered False 17:14:13.311095 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:14:14.463804 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.475934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:14.537465 tst mo_mt_call_osmux.py: using LAC 35058 17:14:14.658827 tst mo_mt_call_osmux.py: using RAC 123 17:14:14.779256 tst mo_mt_call_osmux.py: using CellId 35058 17:14:14.904574 tst mo_mt_call_osmux.py: using BVCI 35059 17:14:15.017852 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.028857 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.039856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.050654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.061538 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:15.072363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:15.195387 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:15.314816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:15.838811 run create_hlr_db(pid=9436): Launched 17:14:16.018326 bus /sierra_2: Setting Powered False 17:14:17.078296 run create_hlr_db(pid=9436): Terminated: ok {rc=0} 17:14:17.532938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Launched 17:14:17.844623 run osmo-hlr_10.42.42.2(pid=9439): Launched 17:14:17.962956 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:18.497665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Launched 17:14:18.810928 run osmo-stp_10.42.42.5(pid=9442): Launched 17:14:18.929910 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:19.496615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Launched 17:14:19.808209 run osmo-msc_10.42.42.6(pid=9445): Launched 17:14:19.980922 run osmo-stp_10.42.42.5(pid=9442): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] 17:14:20.111709 run osmo-stp_10.42.42.5(pid=9442): stdout: | (launched: 2022-12-13_17:14:18.752041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:20.242672 run osmo-stp_10.42.42.5(pid=9442): stderr: | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171418928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:20.371154 run osmo-stp_10.42.42.5(pid=9442): stdout: | (launched: 2022-12-13_17:14:18.752041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:20.494291 run osmo-stp_10.42.42.5(pid=9442): stderr: | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171418927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171418928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171418928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:20.640831 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9442): Process ended prematurely: osmo-stp_10.42.42.5(pid=9442) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:14:20.649921 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:14:20.676300 run osmo-hlr_10.42.42.2(pid=9439): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9439)] 17:14:20.724313 run osmo-hlr_10.42.42.2(pid=9439): stdout: | (launched: 2022-12-13_17:14:17.786095) 17:14:20.773947 run osmo-hlr_10.42.42.2(pid=9439): stderr: | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171417966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171417979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171417987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171417988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171417988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:20.843329 run osmo-msc_10.42.42.6(pid=9445): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9445)] 17:14:20.891405 run osmo-msc_10.42.42.6(pid=9445): stdout: | (launched: 2022-12-13_17:14:19.749764) 17:14:20.941420 run osmo-msc_10.42.42.6(pid=9445): stderr: | [0;m[38;5;43m20221213171420024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171420024 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e00209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171420024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171420024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171420025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171420025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171420026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171420027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171420027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171420027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:20.991390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Terminating (SIGTERM) 17:14:21.031462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Terminating (SIGTERM) 17:14:21.071570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Terminating (SIGTERM) 17:14:21.111926 --- ParallelTerminationStrategy: PID 9438 died... 17:14:21.131213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Terminated: ok {rc=0} 17:14:21.175448 --- ParallelTerminationStrategy: PID 9441 died... 17:14:21.194360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Terminated: ok {rc=0} 17:14:21.238560 --- ParallelTerminationStrategy: PID 9444 died... 17:14:21.257193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Terminated: ok {rc=0} 17:14:21.344056 bus /sierra_3: Setting Powered False 17:14:22.444751 bus /sierra_3: Setting Powered False 17:14:23.562905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:14:24.797383 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:24.804036 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:14:24.825019 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:14:24.851842 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:14:24.909136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:14:24.929800 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:14:24.956080 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:14:25.500204 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:14:25.550673 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:25.562267 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:25.616728 tst mo_mt_call.py: using LAC 35059 17:14:25.736911 tst mo_mt_call.py: using RAC 124 17:14:25.856829 tst mo_mt_call.py: using CellId 35059 17:14:25.976645 tst mo_mt_call.py: using BVCI 35060 17:14:26.088569 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.099679 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.110654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.121654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.132603 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.143660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:26.265341 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:26.385499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:26.901970 run create_hlr_db(pid=9450): Launched 17:14:27.030085 bus /sierra_2: Setting Powered False 17:14:28.095214 run create_hlr_db(pid=9450): Terminated: ok {rc=0} 17:14:28.541046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9452): Launched 17:14:28.853630 run osmo-hlr_10.42.42.2(pid=9453): Launched 17:14:28.972009 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:29.507519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9455): Launched 17:14:29.843036 run osmo-stp_10.42.42.5(pid=9456): Launched 17:14:29.969969 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:30.572684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9458): Launched 17:14:30.917848 run osmo-msc_10.42.42.6(pid=9459): Launched 17:14:31.138263 run osmo-stp_10.42.42.5(pid=9456): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9456)] 17:14:31.309180 run osmo-stp_10.42.42.5(pid=9456): stdout: | (launched: 2022-12-13_17:14:29.780783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:31.480904 run osmo-stp_10.42.42.5(pid=9456): stderr: | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171429977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:31.879034 run osmo-stp_10.42.42.5(pid=9456): stdout: | (launched: 2022-12-13_17:14:29.780783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:32.114550 run osmo-stp_10.42.42.5(pid=9456): stderr: | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171429976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171429977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171429977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:32.276937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9456): Process ended prematurely: osmo-stp_10.42.42.5(pid=9456) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9456)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:14:32.287512 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 17:14:32.316794 run osmo-hlr_10.42.42.2(pid=9453): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9453)] 17:14:32.372772 run osmo-hlr_10.42.42.2(pid=9453): stdout: | (launched: 2022-12-13_17:14:28.794655) 17:14:32.427956 run osmo-hlr_10.42.42.2(pid=9453): stderr: | [0;m[1;31m20221213171428973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171428973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171428974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171428974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171428974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171428974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171428986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171428994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171428995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171428995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:32.503650 run osmo-msc_10.42.42.6(pid=9459): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9459)] 17:14:32.557487 run osmo-msc_10.42.42.6(pid=9459): stdout: | (launched: 2022-12-13_17:14:30.848065) 17:14:32.611169 run osmo-msc_10.42.42.6(pid=9459): stderr: | [0;m[38;5;43m20221213171431580 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171431580 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac6241dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171431580 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171431581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171431581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171431582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171431584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171431584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171431584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171431584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:32.664463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9452): Terminating (SIGTERM) 17:14:32.707620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9455): Terminating (SIGTERM) 17:14:32.751093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9458): Terminating (SIGTERM) 17:14:32.794791 --- ParallelTerminationStrategy: PID 9452 died... 17:14:32.816090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9452): Terminated: ok {rc=0} 17:14:32.864033 --- ParallelTerminationStrategy: PID 9455 died... 17:14:32.884759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9455): Terminated: ok {rc=0} 17:14:32.932497 --- ParallelTerminationStrategy: PID 9458 died... 17:14:32.953413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9458): Terminated: ok {rc=0} 17:14:33.044588 bus /sierra_3: Setting Powered False 17:14:34.145518 bus /sierra_3: Setting Powered False 17:14:35.263552 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:14:36.415078 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.427348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:36.486608 tst mo_mt_call_osmux.py: using LAC 35060 17:14:36.617377 tst mo_mt_call_osmux.py: using RAC 125 17:14:36.752740 tst mo_mt_call_osmux.py: using CellId 35060 17:14:36.881760 tst mo_mt_call_osmux.py: using BVCI 35061 17:14:37.004281 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.015943 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.027437 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.038900 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.050636 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:37.062402 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:37.181790 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:37.307690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:37.820899 run create_hlr_db(pid=9461): Launched 17:14:37.946801 bus /sierra_2: Setting Powered False 17:14:39.012243 run create_hlr_db(pid=9461): Terminated: ok {rc=0} 17:14:39.474158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9463): Launched 17:14:39.806438 run osmo-hlr_10.42.42.2(pid=9464): Launched 17:14:39.932786 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:40.501146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9466): Launched 17:14:40.833696 run osmo-stp_10.42.42.5(pid=9467): Launched 17:14:40.960040 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:41.561196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9469): Launched 17:14:41.894492 run osmo-msc_10.42.42.6(pid=9470): Launched 17:14:42.078892 run osmo-stp_10.42.42.5(pid=9467): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9467)] 17:14:42.218642 run osmo-stp_10.42.42.5(pid=9467): stdout: | (launched: 2022-12-13_17:14:40.771573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:42.359177 run osmo-stp_10.42.42.5(pid=9467): stderr: | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171440967 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:42.497978 run osmo-stp_10.42.42.5(pid=9467): stdout: | (launched: 2022-12-13_17:14:40.771573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:42.630193 run osmo-stp_10.42.42.5(pid=9467): stderr: | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171440967 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:42.788084 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9467): Process ended prematurely: osmo-stp_10.42.42.5(pid=9467) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9467)] [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:14:42.797560 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:14:42.825244 run osmo-hlr_10.42.42.2(pid=9464): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9464)] 17:14:42.876437 run osmo-hlr_10.42.42.2(pid=9464): stdout: | (launched: 2022-12-13_17:14:39.744311) 17:14:42.929443 run osmo-hlr_10.42.42.2(pid=9464): stderr: | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171439945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171439984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171439993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171439993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171439993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:43.002475 run osmo-msc_10.42.42.6(pid=9470): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9470)] 17:14:43.052702 run osmo-msc_10.42.42.6(pid=9470): stdout: | (launched: 2022-12-13_17:14:41.832136) 17:14:43.105530 run osmo-msc_10.42.42.6(pid=9470): stderr: | [0;m[38;5;43m20221213171442156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171442156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4217b79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171442157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171442157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171442157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171442157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171442159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171442159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171442159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171442159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:43.158355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9463): Terminating (SIGTERM) 17:14:43.200073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9466): Terminating (SIGTERM) 17:14:43.242829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9469): Terminating (SIGTERM) 17:14:43.285293 --- ParallelTerminationStrategy: PID 9463 died... 17:14:43.305590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9463): Terminated: ok {rc=0} 17:14:43.352244 --- ParallelTerminationStrategy: PID 9466 died... 17:14:43.372138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9466): Terminated: ok {rc=0} 17:14:43.418550 --- ParallelTerminationStrategy: PID 9469 died... 17:14:43.438413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9469): Terminated: ok {rc=0} 17:14:43.528433 bus /sierra_3: Setting Powered False 17:14:44.629182 bus /sierra_3: Setting Powered False 17:14:45.744914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:14:47.008234 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:47.015340 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:14:47.037240 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:14:47.065522 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:14:47.123755 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:14:47.148802 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:14:47.181101 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:14:47.717354 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:14:47.768325 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:47.779599 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:47.837382 tst mo_mt_call.py: using LAC 35061 17:14:47.959476 tst mo_mt_call.py: using RAC 126 17:14:48.083998 tst mo_mt_call.py: using CellId 35061 17:14:48.209356 tst mo_mt_call.py: using BVCI 35062 17:14:48.323726 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.334990 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.346377 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.357179 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.367859 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.379335 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.501647 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.624226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:49.140340 run create_hlr_db(pid=9475): Launched 17:14:49.267454 bus /sierra_2: Setting Powered False 17:14:50.333194 run create_hlr_db(pid=9475): Terminated: ok {rc=0} 17:14:50.781725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9477): Launched 17:14:51.094861 run osmo-hlr_10.42.42.2(pid=9478): Launched 17:14:51.213671 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:51.769824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9480): Launched 17:14:52.084200 run osmo-stp_10.42.42.5(pid=9481): Launched 17:14:52.202333 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:52.766805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9483): Launched 17:14:53.079858 run osmo-msc_10.42.42.6(pid=9484): Launched 17:14:53.252743 run osmo-stp_10.42.42.5(pid=9481): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9481)] 17:14:53.383168 run osmo-stp_10.42.42.5(pid=9481): stdout: | (launched: 2022-12-13_17:14:52.024614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:53.514161 run osmo-stp_10.42.42.5(pid=9481): stderr: | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171452201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:53.643273 run osmo-stp_10.42.42.5(pid=9481): stdout: | (launched: 2022-12-13_17:14:52.024614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:53.766689 run osmo-stp_10.42.42.5(pid=9481): stderr: | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171452200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171452201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171452201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:53.914244 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9481): Process ended prematurely: osmo-stp_10.42.42.5(pid=9481) [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9481)] [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:14:53.923359 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:14:53.949853 run osmo-hlr_10.42.42.2(pid=9478): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9478)] 17:14:53.998146 run osmo-hlr_10.42.42.2(pid=9478): stdout: | (launched: 2022-12-13_17:14:51.035957) 17:14:54.048411 run osmo-hlr_10.42.42.2(pid=9478): stderr: | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171451218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171451230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171451239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171451239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171451240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:54.118268 run osmo-msc_10.42.42.6(pid=9484): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9484)] 17:14:54.166527 run osmo-msc_10.42.42.6(pid=9484): stdout: | (launched: 2022-12-13_17:14:53.020542) 17:14:54.216645 run osmo-msc_10.42.42.6(pid=9484): stderr: | [0;m[38;5;43m20221213171453295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171453295 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa16af7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171453295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171453295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171453295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171453295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171453297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:54.266944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9477): Terminating (SIGTERM) 17:14:54.307090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9480): Terminating (SIGTERM) 17:14:54.347209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9483): Terminating (SIGTERM) 17:14:54.387598 --- ParallelTerminationStrategy: PID 9477 died... 17:14:54.407177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9477): Terminated: ok {rc=0} 17:14:54.452071 --- ParallelTerminationStrategy: PID 9480 died... 17:14:54.470829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9480): Terminated: ok {rc=0} 17:14:54.515716 --- ParallelTerminationStrategy: PID 9483 died... 17:14:54.534854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9483): Terminated: ok {rc=0} 17:14:54.620094 bus /sierra_3: Setting Powered False 17:14:55.720615 bus /sierra_3: Setting Powered False 17:14:56.838367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:14:57.990862 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.003240 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:58.063115 tst mo_mt_call_osmux.py: using LAC 35062 17:14:58.194060 tst mo_mt_call_osmux.py: using RAC 127 17:14:58.324232 tst mo_mt_call_osmux.py: using CellId 35062 17:14:58.449165 tst mo_mt_call_osmux.py: using BVCI 35063 17:14:58.563574 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.574955 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.586231 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.597314 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.608427 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.619550 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:58.736183 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:58.854252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:59.335366 run create_hlr_db(pid=9486): Launched 17:14:59.461483 bus /sierra_2: Setting Powered False 17:15:00.523377 run create_hlr_db(pid=9486): Terminated: ok {rc=0} 17:15:01.006370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9488): Launched 17:15:01.373737 run osmo-hlr_10.42.42.2(pid=9492): Launched 17:15:01.595632 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:02.327146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9494): Launched 17:15:02.662975 run osmo-stp_10.42.42.5(pid=9495): Launched 17:15:02.788794 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:03.389944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9497): Launched 17:15:03.726906 run osmo-msc_10.42.42.6(pid=9498): Launched 17:15:03.911677 run osmo-stp_10.42.42.5(pid=9495): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9495)] 17:15:04.051265 run osmo-stp_10.42.42.5(pid=9495): stdout: | (launched: 2022-12-13_17:15:02.600256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:04.192098 run osmo-stp_10.42.42.5(pid=9495): stderr: | [0;m[38;5;43m20221213171502798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171502798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171502799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171502799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171502799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171502799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171502800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:04.330987 run osmo-stp_10.42.42.5(pid=9495): stdout: | (launched: 2022-12-13_17:15:02.600256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:04.462825 run osmo-stp_10.42.42.5(pid=9495): stderr: | [0;m[38;5;43m20221213171502798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171502798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171502799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171502799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171502799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171502799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171502800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:04.621423 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9495): Process ended prematurely: osmo-stp_10.42.42.5(pid=9495) [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9495)] [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:15:04.631074 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 17:15:04.659030 run osmo-hlr_10.42.42.2(pid=9492): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9492)] 17:15:04.710377 run osmo-hlr_10.42.42.2(pid=9492): stdout: | (launched: 2022-12-13_17:15:01.309558) 17:15:04.763816 run osmo-hlr_10.42.42.2(pid=9492): stderr: | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171501641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171501658 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171501680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171501680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171501680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:04.837347 run osmo-msc_10.42.42.6(pid=9498): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9498)] 17:15:04.888196 run osmo-msc_10.42.42.6(pid=9498): stdout: | (launched: 2022-12-13_17:15:03.664554) 17:15:04.941385 run osmo-msc_10.42.42.6(pid=9498): stderr: | [0;m[38;5;43m20221213171503988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171503988 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f206b8f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171503988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171503988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171503988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171503988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171503990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171503991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171503991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171503991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:04.994236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9488): Terminating (SIGTERM) 17:15:05.036398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9494): Terminating (SIGTERM) 17:15:05.079320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9497): Terminating (SIGTERM) 17:15:05.122374 --- ParallelTerminationStrategy: PID 9488 died... 17:15:05.143212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9488): Terminated: ok {rc=0} 17:15:05.190146 --- ParallelTerminationStrategy: PID 9494 died... 17:15:05.210498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9494): Terminated: ok {rc=0} 17:15:05.257601 --- ParallelTerminationStrategy: PID 9497 died... 17:15:05.277929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9497): Terminated: ok {rc=0} 17:15:05.367545 bus /sierra_3: Setting Powered False 17:15:06.467187 bus /sierra_3: Setting Powered False 17:15:07.585115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:15:08.824794 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:08.830982 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:15:08.852390 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:15:08.880865 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:15:08.933994 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:15:08.955810 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:15:08.983688 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:15:09.530146 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:15:09.580695 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.591826 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:09.647904 tst mo_mt_call.py: using LAC 35063 17:15:09.769815 tst mo_mt_call.py: using RAC 128 17:15:09.892501 tst mo_mt_call.py: using CellId 35063 17:15:10.015744 tst mo_mt_call.py: using BVCI 35064 17:15:10.129668 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.140444 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.151337 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.162030 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.172517 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:10.183177 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:10.307297 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:10.429860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:10.914844 run create_hlr_db(pid=9503): Launched 17:15:11.041723 bus /sierra_2: Setting Powered False 17:15:12.104509 run create_hlr_db(pid=9503): Terminated: ok {rc=0} 17:15:12.562057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Launched 17:15:12.898201 run osmo-hlr_10.42.42.2(pid=9506): Launched 17:15:13.025256 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:13.602482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Launched 17:15:13.936281 run osmo-stp_10.42.42.5(pid=9509): Launched 17:15:14.062697 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:14.665527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Launched 17:15:15.000156 run osmo-msc_10.42.42.6(pid=9512): Launched 17:15:15.184880 run osmo-stp_10.42.42.5(pid=9509): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] 17:15:15.324352 run osmo-stp_10.42.42.5(pid=9509): stdout: | (launched: 2022-12-13_17:15:13.874244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:15.465560 run osmo-stp_10.42.42.5(pid=9509): stderr: | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171514070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:15.604743 run osmo-stp_10.42.42.5(pid=9509): stdout: | (launched: 2022-12-13_17:15:13.874244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:15.736860 run osmo-stp_10.42.42.5(pid=9509): stderr: | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171514069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171514070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171514070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:15.917104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9509): Process ended prematurely: osmo-stp_10.42.42.5(pid=9509) [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:15:15.927350 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:15:15.956112 run osmo-hlr_10.42.42.2(pid=9506): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9506)] 17:15:16.010664 run osmo-hlr_10.42.42.2(pid=9506): stdout: | (launched: 2022-12-13_17:15:12.835671) 17:15:16.068720 run osmo-hlr_10.42.42.2(pid=9506): stderr: | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171513040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171513052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171513060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171513061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171513061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:16.142014 run osmo-msc_10.42.42.6(pid=9512): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9512)] 17:15:16.191619 run osmo-msc_10.42.42.6(pid=9512): stdout: | (launched: 2022-12-13_17:15:14.937784) 17:15:16.243737 run osmo-msc_10.42.42.6(pid=9512): stderr: | [0;m[38;5;43m20221213171515262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171515262 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb8dc63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171515262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171515262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171515262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171515263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171515264 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171515265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171515265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171515265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:16.295805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Terminating (SIGTERM) 17:15:16.339470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Terminating (SIGTERM) 17:15:16.383843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Terminating (SIGTERM) 17:15:16.429917 --- ParallelTerminationStrategy: PID 9505 died... 17:15:16.450367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Terminated: ok {rc=0} 17:15:16.498863 --- ParallelTerminationStrategy: PID 9508 died... 17:15:16.520189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Terminated: ok {rc=0} 17:15:16.567065 --- ParallelTerminationStrategy: PID 9511 died... 17:15:16.587807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Terminated: ok {rc=0} 17:15:16.676831 bus /sierra_3: Setting Powered False 17:15:17.775537 bus /sierra_3: Setting Powered False 17:15:18.893313 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:15:20.043442 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.055265 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:20.115801 tst mo_mt_call_osmux.py: using LAC 35064 17:15:20.236650 tst mo_mt_call_osmux.py: using RAC 129 17:15:20.357415 tst mo_mt_call_osmux.py: using CellId 35064 17:15:20.479656 tst mo_mt_call_osmux.py: using BVCI 35065 17:15:20.592307 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.603395 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.614125 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.624835 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.635565 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:20.646309 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:20.768461 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:20.894146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:21.409594 run create_hlr_db(pid=9514): Launched 17:15:21.536337 bus /sierra_2: Setting Powered False 17:15:22.602406 run create_hlr_db(pid=9514): Terminated: ok {rc=0} 17:15:23.051408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Launched 17:15:23.364547 run osmo-hlr_10.42.42.2(pid=9517): Launched 17:15:23.482885 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:24.019730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Launched 17:15:24.332109 run osmo-stp_10.42.42.5(pid=9520): Launched 17:15:24.451218 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:25.014689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Launched 17:15:25.327849 run osmo-msc_10.42.42.6(pid=9523): Launched 17:15:25.501296 run osmo-stp_10.42.42.5(pid=9520): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] 17:15:25.632805 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-13_17:15:24.273397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:25.763868 run osmo-stp_10.42.42.5(pid=9520): stderr: | [0;m[38;5;43m20221213171524446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171524447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171524447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171524447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:25.892925 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-13_17:15:24.273397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:26.016254 run osmo-stp_10.42.42.5(pid=9520): stderr: | [0;m[38;5;43m20221213171524446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171524447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171524447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171524447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171524448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:26.163950 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:15:26.172879 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:15:26.199364 run osmo-hlr_10.42.42.2(pid=9517): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9517)] 17:15:26.247799 run osmo-hlr_10.42.42.2(pid=9517): stdout: | (launched: 2022-12-13_17:15:23.305530) 17:15:26.297898 run osmo-hlr_10.42.42.2(pid=9517): stderr: | [0;m[1;31m20221213171523483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171523483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171523483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171523483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171523484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171523484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171523499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171523508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171523508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171523508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:26.367709 run osmo-msc_10.42.42.6(pid=9523): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9523)] 17:15:26.416018 run osmo-msc_10.42.42.6(pid=9523): stdout: | (launched: 2022-12-13_17:15:25.268504) 17:15:26.465924 run osmo-msc_10.42.42.6(pid=9523): stderr: | [0;m[38;5;43m20221213171525543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171525543 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa10d3a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171525543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171525543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171525544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171525544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171525546 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171525546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171525546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171525546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:26.516211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminating (SIGTERM) 17:15:26.556225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminating (SIGTERM) 17:15:26.596054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminating (SIGTERM) 17:15:26.636700 --- ParallelTerminationStrategy: PID 9516 died... 17:15:26.656028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminated: ok {rc=0} 17:15:26.700419 --- ParallelTerminationStrategy: PID 9519 died... 17:15:26.719276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminated: ok {rc=0} 17:15:26.763388 --- ParallelTerminationStrategy: PID 9522 died... 17:15:26.782201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminated: ok {rc=0} 17:15:26.866478 bus /sierra_3: Setting Powered False 17:15:27.963536 bus /sierra_3: Setting Powered False 17:15:29.079040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:sysmo --------------------------------------------------------------------- 17:15:30.310568 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:30.314922 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 17:15:30.335662 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 17:15:30.362802 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 17:15:30.446653 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 17:15:30.467515 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 17:15:30.494113 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 17:15:31.086251 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 17:15:31.092197 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.103532 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:31.141836 tst emergency_mo_mt_call.py: using LAC 35065 17:15:31.263620 tst emergency_mo_mt_call.py: using RAC 130 17:15:31.393699 tst emergency_mo_mt_call.py: using CellId 35065 17:15:31.524113 tst emergency_mo_mt_call.py: using BVCI 35066 17:15:31.684169 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.699717 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.716078 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.732014 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.748111 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:31.764131 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:31.896617 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:32.015513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:32.564564 run create_hlr_db(pid=9528): Launched 17:15:32.691002 bus /sierra_2: Setting Powered False 17:15:33.755463 run create_hlr_db(pid=9528): Terminated: ok {rc=0} 17:15:34.194552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9530): Launched 17:15:34.503603 run osmo-hlr_10.42.42.2(pid=9531): Launched 17:15:34.620056 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:35.148600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9533): Launched 17:15:35.456591 run osmo-stp_10.42.42.5(pid=9534): Launched 17:15:35.584042 tst emergency_mo_mt_call.py: using MSISDN 8245 17:15:35.741255 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:36.291592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9536): Launched 17:15:36.598510 run osmo-msc_10.42.42.6(pid=9537): Launched 17:15:36.768547 run osmo-stp_10.42.42.5(pid=9534): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9534)] 17:15:36.896868 run osmo-stp_10.42.42.5(pid=9534): stdout: | (launched: 2022-12-13_17:15:35.398693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:37.024821 run osmo-stp_10.42.42.5(pid=9534): stderr: | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171535573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171535575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171535576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171535576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:37.152745 run osmo-stp_10.42.42.5(pid=9534): stdout: | (launched: 2022-12-13_17:15:35.398693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:37.274038 run osmo-stp_10.42.42.5(pid=9534): stderr: | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171535572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171535573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171535575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171535576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171535576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:37.419516 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9534): Process ended prematurely: osmo-stp_10.42.42.5(pid=9534) [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9534)] [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py:19] 17:15:37.427783 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 17:15:37.454148 run osmo-hlr_10.42.42.2(pid=9531): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9531)] 17:15:37.502902 run osmo-hlr_10.42.42.2(pid=9531): stdout: | (launched: 2022-12-13_17:15:34.445428) 17:15:37.553270 run osmo-hlr_10.42.42.2(pid=9531): stderr: | [0;m[1;31m20221213171534626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171534626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171534626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171534626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171534626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171534627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171534639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171534648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171534648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171534648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:37.622844 run osmo-msc_10.42.42.6(pid=9537): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9537)] 17:15:37.671322 run osmo-msc_10.42.42.6(pid=9537): stdout: | (launched: 2022-12-13_17:15:36.540309) 17:15:37.721339 run osmo-msc_10.42.42.6(pid=9537): stderr: | [0;m[38;5;43m20221213171536816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171536816 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1cc87a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171536816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171536816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171536816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171536816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171536818 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171536819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171536819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171536819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:37.771585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9530): Terminating (SIGTERM) 17:15:37.811371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9533): Terminating (SIGTERM) 17:15:37.851158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9536): Terminating (SIGTERM) 17:15:37.891079 --- ParallelTerminationStrategy: PID 9530 died... 17:15:37.909800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9530): Terminated: ok {rc=0} 17:15:37.953839 --- ParallelTerminationStrategy: PID 9533 died... 17:15:37.972478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9533): Terminated: ok {rc=0} 17:15:38.016561 --- ParallelTerminationStrategy: PID 9536 died... 17:15:38.035287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9536): Terminated: ok {rc=0} 17:15:38.121515 bus /sierra_3: Setting Powered False 17:15:39.221113 bus /sierra_3: Setting Powered False 17:15:40.334410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 17:15:41.419327 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.430859 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:41.468058 tst emergency_preemptive_call.py: using LAC 35066 17:15:41.598978 tst emergency_preemptive_call.py: using RAC 131 17:15:41.727980 tst emergency_preemptive_call.py: using CellId 35066 17:15:41.856637 tst emergency_preemptive_call.py: using BVCI 35067 17:15:41.977004 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.988105 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.999274 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.010508 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.021807 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:42.033595 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.151939 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.275306 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.391264 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.506796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:42.980525 run create_hlr_db(pid=9539): Launched 17:15:43.105325 bus /sierra_2: Setting Powered False 17:15:44.165996 run create_hlr_db(pid=9539): Terminated: ok {rc=0} 17:15:44.594263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Launched 17:15:44.902660 run osmo-hlr_10.42.42.2(pid=9542): Launched 17:15:45.018983 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:45.551914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Launched 17:15:45.884360 run osmo-stp_10.42.42.5(pid=9545): Launched 17:15:46.129483 tst emergency_preemptive_call.py: using MSISDN 8246 17:15:46.337648 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:46.899804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9547): Launched 17:15:47.224019 run osmo-msc_10.42.42.6(pid=9548): Launched 17:15:47.501591 run osmo-stp_10.42.42.5(pid=9545): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] 17:15:47.631274 run osmo-stp_10.42.42.5(pid=9545): stdout: | (launched: 2022-12-13_17:15:45.800673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:47.759021 run osmo-stp_10.42.42.5(pid=9545): stderr: | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171546041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:47.886569 run osmo-stp_10.42.42.5(pid=9545): stdout: | (launched: 2022-12-13_17:15:45.800673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:48.008498 run osmo-stp_10.42.42.5(pid=9545): stderr: | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171546040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171546041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171546041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:48.154853 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9545): Process ended prematurely: osmo-stp_10.42.42.5(pid=9545) [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py:32] 17:15:48.163161 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 17:15:48.189537 run osmo-hlr_10.42.42.2(pid=9542): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9542)] 17:15:48.238422 run osmo-hlr_10.42.42.2(pid=9542): stdout: | (launched: 2022-12-13_17:15:44.844392) 17:15:48.288659 run osmo-hlr_10.42.42.2(pid=9542): stderr: | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171545026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171545038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171545047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171545047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171545047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:48.358819 run osmo-msc_10.42.42.6(pid=9548): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9548)] 17:15:48.408350 run osmo-msc_10.42.42.6(pid=9548): stdout: | (launched: 2022-12-13_17:15:47.164330) 17:15:48.458390 run osmo-msc_10.42.42.6(pid=9548): stderr: | [0;m[38;5;43m20221213171547494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213171547494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f281b682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213171547494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213171547494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213171547495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213171547495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213171547497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213171547497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213171547497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213171547497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:48.508886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Terminating (SIGTERM) 17:15:48.549232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Terminating (SIGTERM) 17:15:48.589485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9547): Terminating (SIGTERM) 17:15:48.630029 --- ParallelTerminationStrategy: PID 9541 died... 17:15:48.649662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Terminated: ok {rc=0} 17:15:48.694634 --- ParallelTerminationStrategy: PID 9544 died... 17:15:48.713627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Terminated: ok {rc=0} 17:15:48.758451 --- ParallelTerminationStrategy: PID 9547 died... 17:15:48.777538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9547): Terminated: ok {rc=0} 17:15:48.864397 bus /sierra_9: Setting Powered False 17:15:49.965648 bus /sierra_9: Setting Powered False 17:15:51.083217 bus /sierra_8: Setting Powered False 17:15:52.183889 bus /sierra_8: Setting Powered False 17:15:53.301635 bus /sierra_3: Setting Powered False 17:15:54.401145 bus /sierra_3: Setting Powered False 17:15:55.522367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:sysmo --------------------------------------------------------------------- 17:15:56.779666 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:56.783934 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 17:15:56.804574 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 17:15:56.843300 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 17:15:56.930598 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 17:15:56.952654 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 17:15:56.993842 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 17:15:57.583127 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 17:15:57.639848 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.650851 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:15:57.689063 tst cs_paging_gprs_active.py: using LAC 35067 17:15:57.823744 tst cs_paging_gprs_active.py: using RAC 132 17:15:57.958686 tst cs_paging_gprs_active.py: using CellId 35067 17:15:58.090648 tst cs_paging_gprs_active.py: using BVCI 35068 17:15:58.206212 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.216917 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.227528 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.238072 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.248266 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.259164 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.270222 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.281259 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:58.292098 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:58.411579 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:58.533160 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:15:58.744723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:15:59.061287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9555): Launched 17:15:59.335986 run iperf3-srv_10.42.42.10(pid=9556): Launched 17:15:59.452657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:15:59.661649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:15:59.976017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Launched 17:16:00.249929 run iperf3-srv_10.42.42.10(pid=9558): Launched 17:16:00.366548 tst cs_paging_gprs_active.py:38: start network... 17:16:00.574905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:01.081508 run create_hlr_db(pid=9559): Launched 17:16:01.244519 bus /sierra_2: Setting Powered False 17:16:02.306760 run create_hlr_db(pid=9559): Terminated: ok {rc=0} 17:16:02.743117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Launched 17:16:03.057395 run osmo-hlr_10.42.42.2(pid=9562): Launched 17:16:03.176154 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:03.731831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Launched 17:16:04.045242 run osmo-stp_10.42.42.5(pid=9565): Launched 17:16:04.164189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:05.674250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9567): Launched 17:16:05.793900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:06.059564 run patchelf(pid=9568): Launched 17:16:06.234811 run osmo-stp_10.42.42.5(pid=9565): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] 17:16:06.367007 run osmo-stp_10.42.42.5(pid=9565): stdout: | (launched: 2022-12-13_17:16:03.986320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:06.500761 run osmo-stp_10.42.42.5(pid=9565): stderr: | [0;m[38;5;43m20221213171604159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171604160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171604160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171604160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:06.634674 run osmo-stp_10.42.42.5(pid=9565): stdout: | (launched: 2022-12-13_17:16:03.986320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:06.762181 run osmo-stp_10.42.42.5(pid=9565): stderr: | [0;m[38;5;43m20221213171604159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171604160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171604160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171604160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171604161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:06.912909 run patchelf(pid=9568): Terminating (SIGINT) 17:16:07.090128 run patchelf(pid=9568): Terminated: ok {rc=0} 17:16:07.217864 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9565): Process ended prematurely: osmo-stp_10.42.42.5(pid=9565) [trial-2392↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] [trial-2392↪gprs:sysmo↪cs_paging_gprs_active.py:38] 17:16:07.227094 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 17:16:07.254358 run osmo-hlr_10.42.42.2(pid=9562): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9562)] 17:16:07.302350 run osmo-hlr_10.42.42.2(pid=9562): stdout: | (launched: 2022-12-13_17:16:02.997990) 17:16:07.352701 run osmo-hlr_10.42.42.2(pid=9562): stderr: | [0;m[1;31m20221213171603181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171603182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171603182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171603182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171603182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171603182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171603194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171603203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171603203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171603204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:07.402832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9555): Terminating (SIGTERM) 17:16:07.443075 run iperf3-srv_10.42.42.10(pid=9556): Terminating (SIGTERM) 17:16:07.483306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Terminating (SIGTERM) 17:16:07.523606 run iperf3-srv_10.42.42.10(pid=9558): Terminating (SIGTERM) 17:16:07.563871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Terminating (SIGTERM) 17:16:07.604049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Terminating (SIGTERM) 17:16:07.644358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9567): Terminating (SIGTERM) 17:16:07.684893 --- ParallelTerminationStrategy: PID 9555 died... 17:16:07.704351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9555): Terminated: ok {rc=0} 17:16:07.749102 --- ParallelTerminationStrategy: PID 9556 died... 17:16:07.768045 run iperf3-srv_10.42.42.10(pid=9556): Terminated {rc=256} 17:16:07.812508 --- ParallelTerminationStrategy: PID 9557 died... 17:16:07.831476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Terminated: ok {rc=0} 17:16:07.875844 --- ParallelTerminationStrategy: PID 9558 died... 17:16:07.894603 run iperf3-srv_10.42.42.10(pid=9558): Terminated {rc=256} 17:16:07.938956 --- ParallelTerminationStrategy: PID 9561 died... 17:16:07.958041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Terminated: ok {rc=0} 17:16:08.002633 --- ParallelTerminationStrategy: PID 9564 died... 17:16:08.021385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Terminated: ok {rc=0} 17:16:08.065727 --- ParallelTerminationStrategy: PID 9567 died... 17:16:08.084600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9567): Terminated: ok {rc=0} 17:16:08.169995 bus /gobi_0: Setting Powered False 17:16:09.271475 bus /gobi_0: Setting Powered False 17:16:10.390784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo iperf3.py ---------------------------------------------- 17:16:11.544707 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.556475 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:11.593791 tst iperf3.py: using LAC 35068 17:16:11.725555 tst iperf3.py: using RAC 133 17:16:11.855360 tst iperf3.py: using CellId 35068 17:16:11.986016 tst iperf3.py: using BVCI 35069 17:16:12.107055 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.118219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.129264 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.140150 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.151310 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.162516 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.173911 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.185179 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:12.196514 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:12.319323 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:12.544751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:12.881140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Launched 17:16:13.172680 run iperf3-srv_10.42.42.10(pid=9570): Launched 17:16:13.296863 tst iperf3.py:8: start network... 17:16:13.521322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:14.037266 run create_hlr_db(pid=9571): Launched 17:16:14.163338 bus /gobi_6: Setting Powered False 17:16:15.228893 run create_hlr_db(pid=9571): Terminated: ok {rc=0} 17:16:15.674923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Launched 17:16:16.022925 run osmo-hlr_10.42.42.2(pid=9574): Launched 17:16:16.327532 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:17.168369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Launched 17:16:17.522288 run osmo-stp_10.42.42.5(pid=9577): Launched 17:16:17.641531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:18.183162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Launched 17:16:18.302915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:18.568614 run patchelf(pid=9580): Launched 17:16:18.742126 run osmo-stp_10.42.42.5(pid=9577): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] 17:16:18.873853 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-13_17:16:17.463039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:19.007122 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171617640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:19.140871 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-13_17:16:17.463039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:19.267773 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171617639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171617640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171617640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:19.418786 run patchelf(pid=9580): Terminating (SIGINT) 17:16:19.595780 run patchelf(pid=9580): Terminated: ok {rc=0} 17:16:19.723320 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2392↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] [trial-2392↪gprs:sysmo↪iperf3.py:8] 17:16:19.732718 tst iperf3.py:8: Test FAILED (8.2 sec) 17:16:19.760004 run osmo-hlr_10.42.42.2(pid=9574): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9574)] 17:16:19.807875 run osmo-hlr_10.42.42.2(pid=9574): stdout: | (launched: 2022-12-13_17:16:15.950465) 17:16:19.857746 run osmo-hlr_10.42.42.2(pid=9574): stderr: | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171616465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171616482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171616498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171616498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171616498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:19.907985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Terminating (SIGTERM) 17:16:19.948266 run iperf3-srv_10.42.42.10(pid=9570): Terminating (SIGTERM) 17:16:19.988512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminating (SIGTERM) 17:16:20.028913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminating (SIGTERM) 17:16:20.069242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminating (SIGTERM) 17:16:20.110145 --- ParallelTerminationStrategy: PID 9569 died... 17:16:20.129737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Terminated: ok {rc=0} 17:16:20.174393 --- ParallelTerminationStrategy: PID 9570 died... 17:16:20.193403 run iperf3-srv_10.42.42.10(pid=9570): Terminated {rc=256} 17:16:20.237826 --- ParallelTerminationStrategy: PID 9573 died... 17:16:20.256518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminated: ok {rc=0} 17:16:20.301342 --- ParallelTerminationStrategy: PID 9576 died... 17:16:20.320338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminated: ok {rc=0} 17:16:20.365050 --- ParallelTerminationStrategy: PID 9579 died... 17:16:20.383963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminated: ok {rc=0} 17:16:20.471233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo iperf3m4.py ---------------------------------------------- 17:16:21.621671 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.633085 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:21.668495 tst iperf3m4.py: using LAC 35069 17:16:21.791757 tst iperf3m4.py: using RAC 134 17:16:21.920852 tst iperf3m4.py: using CellId 35069 17:16:22.051387 tst iperf3m4.py: using BVCI 35070 17:16:22.173264 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.184441 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.195560 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.206726 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.218488 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.230114 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.241942 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.253665 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:22.265564 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.386597 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.512116 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.631600 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.749125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:22.957812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:23.272594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Launched 17:16:23.547243 run iperf3-srv_10.42.42.10(pid=9582): Launched 17:16:23.664097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:16:23.873457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:24.188614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9583): Launched 17:16:24.463700 run iperf3-srv_10.42.42.10(pid=9584): Launched 17:16:24.580888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:16:24.790359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:25.105474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Launched 17:16:25.380072 run iperf3-srv_10.42.42.10(pid=9586): Launched 17:16:25.497340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:16:25.705996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:26.020742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Launched 17:16:26.311097 run iperf3-srv_10.42.42.10(pid=9588): Launched 17:16:26.437254 tst iperf3m4.py:8: start network... 17:16:26.663350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:27.184620 run create_hlr_db(pid=9589): Launched 17:16:27.312306 bus /gobi_6: Setting Powered False 17:16:28.378060 run create_hlr_db(pid=9589): Terminated: ok {rc=0} 17:16:28.844263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Launched 17:16:29.179809 run osmo-hlr_10.42.42.2(pid=9592): Launched 17:16:29.307399 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:29.883698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Launched 17:16:30.218411 run osmo-stp_10.42.42.5(pid=9595): Launched 17:16:30.347594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:30.932760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Launched 17:16:31.074144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:31.364601 run patchelf(pid=9598): Launched 17:16:31.566869 run osmo-stp_10.42.42.5(pid=9595): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] 17:16:31.712308 run osmo-stp_10.42.42.5(pid=9595): stdout: | (launched: 2022-12-13_17:16:30.155699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:31.858469 run osmo-stp_10.42.42.5(pid=9595): stderr: | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171630352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:32.005372 run osmo-stp_10.42.42.5(pid=9595): stdout: | (launched: 2022-12-13_17:16:30.155699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:32.144733 run osmo-stp_10.42.42.5(pid=9595): stderr: | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171630351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171630352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171630352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:32.307218 run patchelf(pid=9598): Terminating (SIGINT) 17:16:32.496094 run patchelf(pid=9598): Terminated: ok {rc=0} 17:16:32.632445 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9595): Process ended prematurely: osmo-stp_10.42.42.5(pid=9595) [trial-2392↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] [trial-2392↪gprs:sysmo↪iperf3m4.py:8] 17:16:32.642613 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:16:32.671869 run osmo-hlr_10.42.42.2(pid=9592): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9592)] 17:16:32.723502 run osmo-hlr_10.42.42.2(pid=9592): stdout: | (launched: 2022-12-13_17:16:29.117028) 17:16:32.776831 run osmo-hlr_10.42.42.2(pid=9592): stderr: | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171629319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171629333 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171629341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171629341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171629341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:32.830690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Terminating (SIGTERM) 17:16:32.873133 run iperf3-srv_10.42.42.10(pid=9582): Terminating (SIGTERM) 17:16:32.915978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9583): Terminating (SIGTERM) 17:16:32.959354 run iperf3-srv_10.42.42.10(pid=9584): Terminating (SIGTERM) 17:16:33.002153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Terminating (SIGTERM) 17:16:33.045439 run iperf3-srv_10.42.42.10(pid=9586): Terminating (SIGTERM) 17:16:33.088169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminating (SIGTERM) 17:16:33.131477 run iperf3-srv_10.42.42.10(pid=9588): Terminating (SIGTERM) 17:16:33.174184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Terminating (SIGTERM) 17:16:33.217188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Terminating (SIGTERM) 17:16:33.259860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Terminating (SIGTERM) 17:16:33.303479 --- ParallelTerminationStrategy: PID 9581 died... 17:16:33.324475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Terminated: ok {rc=0} 17:16:33.372022 --- ParallelTerminationStrategy: PID 9582 died... 17:16:33.392108 run iperf3-srv_10.42.42.10(pid=9582): Terminated {rc=256} 17:16:33.439169 --- ParallelTerminationStrategy: PID 9583 died... 17:16:33.459327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9583): Terminated: ok {rc=0} 17:16:33.506780 --- ParallelTerminationStrategy: PID 9584 died... 17:16:33.527131 run iperf3-srv_10.42.42.10(pid=9584): Terminated {rc=256} 17:16:33.574589 --- ParallelTerminationStrategy: PID 9585 died... 17:16:33.594828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Terminated: ok {rc=0} 17:16:33.642483 --- ParallelTerminationStrategy: PID 9586 died... 17:16:33.662806 run iperf3-srv_10.42.42.10(pid=9586): Terminated {rc=256} 17:16:33.709772 --- ParallelTerminationStrategy: PID 9587 died... 17:16:33.730116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminated: ok {rc=0} 17:16:33.777363 --- ParallelTerminationStrategy: PID 9588 died... 17:16:33.797547 run iperf3-srv_10.42.42.10(pid=9588): Terminated {rc=256} 17:16:33.844751 --- ParallelTerminationStrategy: PID 9591 died... 17:16:33.865049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Terminated: ok {rc=0} 17:16:33.911995 --- ParallelTerminationStrategy: PID 9594 died... 17:16:33.932288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Terminated: ok {rc=0} 17:16:33.979427 --- ParallelTerminationStrategy: PID 9597 died... 17:16:33.999693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Terminated: ok {rc=0} 17:16:34.088733 bus /gobi_4: Setting Powered False 17:16:35.188635 bus /gobi_4: Setting Powered False 17:16:36.306300 bus /gobi_1: Setting Powered False 17:16:37.407481 bus /gobi_1: Setting Powered False 17:16:38.524386 bus /gobi_0: Setting Powered False 17:16:39.624354 bus /gobi_0: Setting Powered False 17:16:40.745506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo ping.py ---------------------------------------------- 17:16:41.849437 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:41.860483 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:41.897396 tst ping.py: using LAC 35070 17:16:42.026782 tst ping.py: using RAC 135 17:16:42.156336 tst ping.py: using CellId 35070 17:16:42.286915 tst ping.py: using BVCI 35071 17:16:42.406958 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.418035 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.428903 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.439849 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.450982 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.462151 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.473398 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.484510 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:42.602493 tst ping.py:19: start network... 17:16:42.809155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:43.285314 run create_hlr_db(pid=9599): Launched 17:16:43.408786 bus /gobi_6: Setting Powered False 17:16:44.473755 run create_hlr_db(pid=9599): Terminated: ok {rc=0} 17:16:44.913142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9601): Launched 17:16:45.220712 run osmo-hlr_10.42.42.2(pid=9602): Launched 17:16:45.336296 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:45.902278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9604): Launched 17:16:46.229979 run osmo-stp_10.42.42.5(pid=9605): Launched 17:16:46.434805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:47.193556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9607): Launched 17:16:47.324926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:47.588552 run patchelf(pid=9608): Launched 17:16:47.758548 run osmo-stp_10.42.42.5(pid=9605): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9605)] 17:16:47.887740 run osmo-stp_10.42.42.5(pid=9605): stdout: | (launched: 2022-12-13_17:16:46.168800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:48.018895 run osmo-stp_10.42.42.5(pid=9605): stderr: | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171646466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171646467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171646468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171646468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:48.149912 run osmo-stp_10.42.42.5(pid=9605): stdout: | (launched: 2022-12-13_17:16:46.168800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:48.274641 run osmo-stp_10.42.42.5(pid=9605): stderr: | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171646460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171646466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171646467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171646468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171646468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:48.422624 run patchelf(pid=9608): Terminating (SIGINT) 17:16:48.595495 run patchelf(pid=9608): Terminated: ok {rc=0} 17:16:48.719998 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9605): Process ended prematurely: osmo-stp_10.42.42.5(pid=9605) [trial-2392↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9605)] [trial-2392↪gprs:sysmo↪ping.py:22] 17:16:48.728805 tst ping.py:22: Test FAILED (6.9 sec) 17:16:48.755536 run osmo-hlr_10.42.42.2(pid=9602): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9602)] 17:16:48.803864 run osmo-hlr_10.42.42.2(pid=9602): stdout: | (launched: 2022-12-13_17:16:45.162492) 17:16:48.853544 run osmo-hlr_10.42.42.2(pid=9602): stderr: | [0;m[1;31m20221213171645344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171645345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171645345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171645345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171645345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171645345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171645357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171645366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171645366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171645366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:48.903460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9601): Terminating (SIGTERM) 17:16:48.943861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9604): Terminating (SIGTERM) 17:16:48.984302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9607): Terminating (SIGTERM) 17:16:49.024904 --- ParallelTerminationStrategy: PID 9601 died... 17:16:49.044444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9601): Terminated: ok {rc=0} 17:16:49.089410 --- ParallelTerminationStrategy: PID 9604 died... 17:16:49.108426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9604): Terminated: ok {rc=0} 17:16:49.152929 --- ParallelTerminationStrategy: PID 9607 died... 17:16:49.172345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9607): Terminated: ok {rc=0} 17:16:49.259518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 17:16:50.351425 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.365536 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:50.401323 tst ping_idle_ping.py: using LAC 35071 17:16:50.529301 tst ping_idle_ping.py: using RAC 136 17:16:50.648837 tst ping_idle_ping.py: using CellId 35071 17:16:50.767760 tst ping_idle_ping.py: using BVCI 35072 17:16:50.879317 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.889900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.900239 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.910675 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.920937 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.932588 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.943612 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.954524 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:51.084323 tst ping_idle_ping.py:24: start network... 17:16:51.306380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:51.816250 run create_hlr_db(pid=9609): Launched 17:16:51.945265 bus /gobi_6: Setting Powered False 17:16:53.010407 run create_hlr_db(pid=9609): Terminated: ok {rc=0} 17:16:53.450698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9611): Launched 17:16:53.759156 run osmo-hlr_10.42.42.2(pid=9612): Launched 17:16:53.876546 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:54.403987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9614): Launched 17:16:54.711037 run osmo-stp_10.42.42.5(pid=9615): Launched 17:16:54.826843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:55.358149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9617): Launched 17:16:55.475524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:55.737392 run patchelf(pid=9618): Launched 17:16:55.907301 run osmo-stp_10.42.42.5(pid=9615): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9615)] 17:16:56.036731 run osmo-stp_10.42.42.5(pid=9615): stdout: | (launched: 2022-12-13_17:16:54.652758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:56.168554 run osmo-stp_10.42.42.5(pid=9615): stderr: | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171654827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:56.300141 run osmo-stp_10.42.42.5(pid=9615): stdout: | (launched: 2022-12-13_17:16:54.652758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:56.425364 run osmo-stp_10.42.42.5(pid=9615): stderr: | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171654826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171654827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171654827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:56.573607 run patchelf(pid=9618): Terminating (SIGINT) 17:16:56.746916 run patchelf(pid=9618): Terminated: ok {rc=0} 17:16:56.872137 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9615): Process ended prematurely: osmo-stp_10.42.42.5(pid=9615) [trial-2392↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9615)] [trial-2392↪gprs:sysmo↪ping_idle_ping.py:27] 17:16:56.881003 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:16:56.907533 run osmo-hlr_10.42.42.2(pid=9612): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9612)] 17:16:56.955496 run osmo-hlr_10.42.42.2(pid=9612): stdout: | (launched: 2022-12-13_17:16:53.701082) 17:16:57.005363 run osmo-hlr_10.42.42.2(pid=9612): stderr: | [0;m[1;31m20221213171653880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171653880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171653880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171653881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171653881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171653881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171653893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171653902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171653902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171653902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:57.055309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9611): Terminating (SIGTERM) 17:16:57.095106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9614): Terminating (SIGTERM) 17:16:57.135078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9617): Terminating (SIGTERM) 17:16:57.175185 --- ParallelTerminationStrategy: PID 9611 died... 17:16:57.194388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9611): Terminated: ok {rc=0} 17:16:57.238560 --- ParallelTerminationStrategy: PID 9614 died... 17:16:57.257253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9614): Terminated: ok {rc=0} 17:16:57.301515 --- ParallelTerminationStrategy: PID 9617 died... 17:16:57.320224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9617): Terminated: ok {rc=0} 17:16:57.406937 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 17:16:58.702134 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:16:58.707980 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:16:58.729546 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:16:58.771938 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:16:58.859717 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:16:58.881232 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:16:58.921310 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:16:59.516934 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:16:59.571931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.583304 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:16:59.619824 tst cs_paging_gprs_active.py: using LAC 35072 17:16:59.744700 tst cs_paging_gprs_active.py: using RAC 137 17:16:59.868861 tst cs_paging_gprs_active.py: using CellId 35072 17:16:59.991072 tst cs_paging_gprs_active.py: using BVCI 35073 17:17:00.107685 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.118635 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.129179 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.139664 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.150141 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.160565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.171269 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.181800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:00.192425 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.314903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.435450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:17:00.647032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:00.988179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9622): Launched 17:17:01.303540 run iperf3-srv_10.42.42.10(pid=9623): Launched 17:17:01.459913 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:17:01.699629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:02.090576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9627): Launched 17:17:02.398343 run iperf3-srv_10.42.42.10(pid=9628): Launched 17:17:02.526571 tst cs_paging_gprs_active.py:38: start network... 17:17:02.753899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:03.273658 run create_hlr_db(pid=9629): Launched 17:17:03.402298 bus /gobi_6: Setting Powered False 17:17:04.467805 run create_hlr_db(pid=9629): Terminated: ok {rc=0} 17:17:04.917160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9631): Launched 17:17:05.232568 run osmo-hlr_10.42.42.2(pid=9632): Launched 17:17:05.352098 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:05.907474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9634): Launched 17:17:06.222413 run osmo-stp_10.42.42.5(pid=9635): Launched 17:17:06.340714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:06.882042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9637): Launched 17:17:07.002132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:07.268166 run patchelf(pid=9638): Launched 17:17:07.442365 run osmo-stp_10.42.42.5(pid=9635): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9635)] 17:17:07.575128 run osmo-stp_10.42.42.5(pid=9635): stdout: | (launched: 2022-12-13_17:17:06.163056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:07.709197 run osmo-stp_10.42.42.5(pid=9635): stderr: | [0;m[38;5;43m20221213171706337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171706337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171706338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171706338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:07.844208 run osmo-stp_10.42.42.5(pid=9635): stdout: | (launched: 2022-12-13_17:17:06.163056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:07.971898 run osmo-stp_10.42.42.5(pid=9635): stderr: | [0;m[38;5;43m20221213171706337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171706337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171706338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171706338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171706340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:08.123421 run patchelf(pid=9638): Terminating (SIGINT) 17:17:08.300475 run patchelf(pid=9638): Terminated: ok {rc=0} 17:17:08.428490 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9635): Process ended prematurely: osmo-stp_10.42.42.5(pid=9635) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9635)] [trial-2392↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:17:08.438179 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:17:08.465500 run osmo-hlr_10.42.42.2(pid=9632): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9632)] 17:17:08.514055 run osmo-hlr_10.42.42.2(pid=9632): stdout: | (launched: 2022-12-13_17:17:05.172932) 17:17:08.564446 run osmo-hlr_10.42.42.2(pid=9632): stderr: | [0;m[1;31m20221213171705353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171705353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171705354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171705354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171705354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171705354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171705366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171705374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171705374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171705374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:08.615240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9622): Terminating (SIGTERM) 17:17:08.655937 run iperf3-srv_10.42.42.10(pid=9623): Terminating (SIGTERM) 17:17:08.696526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9627): Terminating (SIGTERM) 17:17:08.737105 run iperf3-srv_10.42.42.10(pid=9628): Terminating (SIGTERM) 17:17:08.777917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9631): Terminating (SIGTERM) 17:17:08.819072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9634): Terminating (SIGTERM) 17:17:08.859925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9637): Terminating (SIGTERM) 17:17:08.901332 --- ParallelTerminationStrategy: PID 9622 died... 17:17:08.920927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9622): Terminated: ok {rc=0} 17:17:08.966109 --- ParallelTerminationStrategy: PID 9623 died... 17:17:08.984923 run iperf3-srv_10.42.42.10(pid=9623): Terminated {rc=256} 17:17:09.029571 --- ParallelTerminationStrategy: PID 9627 died... 17:17:09.048684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9627): Terminated: ok {rc=0} 17:17:09.093579 --- ParallelTerminationStrategy: PID 9628 died... 17:17:09.112388 run iperf3-srv_10.42.42.10(pid=9628): Terminated {rc=256} 17:17:09.157053 --- ParallelTerminationStrategy: PID 9631 died... 17:17:09.175995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9631): Terminated: ok {rc=0} 17:17:09.220565 --- ParallelTerminationStrategy: PID 9634 died... 17:17:09.239529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9634): Terminated: ok {rc=0} 17:17:09.284165 --- ParallelTerminationStrategy: PID 9637 died... 17:17:09.303335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9637): Terminated: ok {rc=0} 17:17:09.390038 bus /gobi_0: Setting Powered False 17:17:10.492718 bus /gobi_0: Setting Powered False 17:17:11.612697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:17:12.762742 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.774378 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:12.811133 tst iperf3.py: using LAC 35073 17:17:12.942897 tst iperf3.py: using RAC 138 17:17:13.078274 tst iperf3.py: using CellId 35073 17:17:13.208100 tst iperf3.py: using BVCI 35074 17:17:13.331048 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.342360 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.353815 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.365306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.376533 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.387819 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.399370 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.410821 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.422359 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:13.545618 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:13.772378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:14.108143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Launched 17:17:14.399793 run iperf3-srv_10.42.42.10(pid=9640): Launched 17:17:14.524797 tst iperf3.py:8: start network... 17:17:14.750453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:15.267388 run create_hlr_db(pid=9641): Launched 17:17:15.393873 bus /gobi_6: Setting Powered False 17:17:16.471422 run create_hlr_db(pid=9641): Terminated: ok {rc=0} 17:17:16.930501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Launched 17:17:17.261987 run osmo-hlr_10.42.42.2(pid=9644): Launched 17:17:17.383571 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:17.940320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Launched 17:17:18.254364 run osmo-stp_10.42.42.5(pid=9647): Launched 17:17:18.372657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:18.911648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Launched 17:17:19.032035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:19.298282 run patchelf(pid=9650): Launched 17:17:19.472156 run osmo-stp_10.42.42.5(pid=9647): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] 17:17:19.604092 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-13_17:17:18.195313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.737837 run osmo-stp_10.42.42.5(pid=9647): stderr: | [0;m[38;5;43m20221213171718368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171718369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171718369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171718369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171718371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171718372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171718372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:19.871452 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-13_17:17:18.195313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.999854 run osmo-stp_10.42.42.5(pid=9647): stderr: | [0;m[38;5;43m20221213171718368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171718369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171718369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171718369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171718371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171718372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171718372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:20.150754 run patchelf(pid=9650): Terminating (SIGINT) 17:17:20.328197 run patchelf(pid=9650): Terminated: ok {rc=0} 17:17:20.455770 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 17:17:20.465290 tst iperf3.py:8: Test FAILED (7.7 sec) 17:17:20.492561 run osmo-hlr_10.42.42.2(pid=9644): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9644)] 17:17:20.540760 run osmo-hlr_10.42.42.2(pid=9644): stdout: | (launched: 2022-12-13_17:17:17.202515) 17:17:20.591134 run osmo-hlr_10.42.42.2(pid=9644): stderr: | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171717380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171717393 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171717402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171717403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171717403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:20.642032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Terminating (SIGTERM) 17:17:20.686187 run iperf3-srv_10.42.42.10(pid=9640): Terminating (SIGTERM) 17:17:20.726818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminating (SIGTERM) 17:17:20.772061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminating (SIGTERM) 17:17:20.816517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminating (SIGTERM) 17:17:20.860289 --- ParallelTerminationStrategy: PID 9639 died... 17:17:20.881070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Terminated: ok {rc=0} 17:17:20.945452 --- ParallelTerminationStrategy: PID 9640 died... 17:17:20.981262 run iperf3-srv_10.42.42.10(pid=9640): Terminated {rc=256} 17:17:21.034365 --- ParallelTerminationStrategy: PID 9643 died... 17:17:21.054584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminated: ok {rc=0} 17:17:21.103487 --- ParallelTerminationStrategy: PID 9646 died... 17:17:21.125750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminated: ok {rc=0} 17:17:21.175800 --- ParallelTerminationStrategy: PID 9649 died... 17:17:21.217485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminated: ok {rc=0} 17:17:21.344886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:17:22.495686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.507130 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:22.548620 tst iperf3m4.py: using LAC 35074 17:17:22.680441 tst iperf3m4.py: using RAC 139 17:17:22.809354 tst iperf3m4.py: using CellId 35074 17:17:22.944759 tst iperf3m4.py: using BVCI 35075 17:17:23.068026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.079251 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.090431 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.101582 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.113089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.124431 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.135974 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.147233 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.158824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.279267 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.403236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.520438 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.642235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:23.868021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:24.206432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9659): Launched 17:17:24.499464 run iperf3-srv_10.42.42.10(pid=9660): Launched 17:17:24.624562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:17:24.850489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:25.188096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Launched 17:17:25.480899 run iperf3-srv_10.42.42.10(pid=9662): Launched 17:17:25.606100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:17:25.831815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:26.170046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Launched 17:17:26.464934 run iperf3-srv_10.42.42.10(pid=9664): Launched 17:17:26.590356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:17:26.816216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:27.154221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Launched 17:17:27.449109 run iperf3-srv_10.42.42.10(pid=9666): Launched 17:17:27.574356 tst iperf3m4.py:8: start network... 17:17:27.800820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:28.319050 run create_hlr_db(pid=9667): Launched 17:17:28.445897 bus /gobi_6: Setting Powered False 17:17:29.507462 run create_hlr_db(pid=9667): Terminated: ok {rc=0} 17:17:29.973154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9669): Launched 17:17:30.308637 run osmo-hlr_10.42.42.2(pid=9670): Launched 17:17:30.436111 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:31.059668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9672): Launched 17:17:31.412264 run osmo-stp_10.42.42.5(pid=9673): Launched 17:17:31.692826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:32.280705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9675): Launched 17:17:32.408688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:32.693632 run patchelf(pid=9676): Launched 17:17:32.879290 run osmo-stp_10.42.42.5(pid=9673): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9673)] 17:17:33.020560 run osmo-stp_10.42.42.5(pid=9673): stdout: | (launched: 2022-12-13_17:17:31.347402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:33.163346 run osmo-stp_10.42.42.5(pid=9673): stderr: | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171731565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171731565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171731565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171731566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:33.306319 run osmo-stp_10.42.42.5(pid=9673): stdout: | (launched: 2022-12-13_17:17:31.347402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:33.442534 run osmo-stp_10.42.42.5(pid=9673): stderr: | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171731564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171731565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171731565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171731565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171731566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:33.603849 run patchelf(pid=9676): Terminating (SIGINT) 17:17:33.793612 run patchelf(pid=9676): Terminated: ok {rc=0} 17:17:33.929808 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9673): Process ended prematurely: osmo-stp_10.42.42.5(pid=9673) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9673)] [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 17:17:33.939913 tst iperf3m4.py:8: Test FAILED (11.5 sec) 17:17:33.969122 run osmo-hlr_10.42.42.2(pid=9670): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9670)] 17:17:34.021088 run osmo-hlr_10.42.42.2(pid=9670): stdout: | (launched: 2022-12-13_17:17:30.246013) 17:17:34.074084 run osmo-hlr_10.42.42.2(pid=9670): stderr: | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171730447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171730459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171730467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171730468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171730468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:34.127660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9659): Terminating (SIGTERM) 17:17:34.170005 run iperf3-srv_10.42.42.10(pid=9660): Terminating (SIGTERM) 17:17:34.212937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Terminating (SIGTERM) 17:17:34.255718 run iperf3-srv_10.42.42.10(pid=9662): Terminating (SIGTERM) 17:17:34.298102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Terminating (SIGTERM) 17:17:34.340580 run iperf3-srv_10.42.42.10(pid=9664): Terminating (SIGTERM) 17:17:34.383079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Terminating (SIGTERM) 17:17:34.425629 run iperf3-srv_10.42.42.10(pid=9666): Terminating (SIGTERM) 17:17:34.468086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9669): Terminating (SIGTERM) 17:17:34.510604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9672): Terminating (SIGTERM) 17:17:34.553166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9675): Terminating (SIGTERM) 17:17:34.595941 --- ParallelTerminationStrategy: PID 9659 died... 17:17:34.616483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9659): Terminated: ok {rc=0} 17:17:34.664447 --- ParallelTerminationStrategy: PID 9660 died... 17:17:34.684646 run iperf3-srv_10.42.42.10(pid=9660): Terminated {rc=256} 17:17:34.731721 --- ParallelTerminationStrategy: PID 9661 died... 17:17:34.751991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Terminated: ok {rc=0} 17:17:34.799017 --- ParallelTerminationStrategy: PID 9662 died... 17:17:34.819056 run iperf3-srv_10.42.42.10(pid=9662): Terminated {rc=256} 17:17:34.865851 --- ParallelTerminationStrategy: PID 9663 died... 17:17:34.886019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Terminated: ok {rc=0} 17:17:34.933078 --- ParallelTerminationStrategy: PID 9664 died... 17:17:34.953310 run iperf3-srv_10.42.42.10(pid=9664): Terminated {rc=256} 17:17:35.000357 --- ParallelTerminationStrategy: PID 9665 died... 17:17:35.020502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Terminated: ok {rc=0} 17:17:35.067662 --- ParallelTerminationStrategy: PID 9666 died... 17:17:35.087956 run iperf3-srv_10.42.42.10(pid=9666): Terminated {rc=256} 17:17:35.135186 --- ParallelTerminationStrategy: PID 9669 died... 17:17:35.155321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9669): Terminated: ok {rc=0} 17:17:35.202340 --- ParallelTerminationStrategy: PID 9672 died... 17:17:35.222516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9672): Terminated: ok {rc=0} 17:17:35.269533 --- ParallelTerminationStrategy: PID 9675 died... 17:17:35.289655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9675): Terminated: ok {rc=0} 17:17:35.379583 bus /gobi_4: Setting Powered False 17:17:36.480028 bus /gobi_4: Setting Powered False 17:17:37.597951 bus /gobi_1: Setting Powered False 17:17:38.697860 bus /gobi_1: Setting Powered False 17:17:39.818475 bus /gobi_0: Setting Powered False 17:17:40.918860 bus /gobi_0: Setting Powered False 17:17:42.036761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 17:17:43.141223 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.152571 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:43.189890 tst ping.py: using LAC 35075 17:17:43.324021 tst ping.py: using RAC 140 17:17:43.451558 tst ping.py: using CellId 35075 17:17:43.578934 tst ping.py: using BVCI 35076 17:17:43.698233 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.709580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.720696 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.731828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.743254 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.754716 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.766213 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.777683 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:43.899361 tst ping.py:19: start network... 17:17:44.107308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:44.585954 run create_hlr_db(pid=9677): Launched 17:17:44.711215 bus /gobi_6: Setting Powered False 17:17:45.772499 run create_hlr_db(pid=9677): Terminated: ok {rc=0} 17:17:46.289299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Launched 17:17:46.641250 run osmo-hlr_10.42.42.2(pid=9680): Launched 17:17:46.947448 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:47.579398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Launched 17:17:47.908648 run osmo-stp_10.42.42.5(pid=9683): Launched 17:17:48.033659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:48.599996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9685): Launched 17:17:48.725660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:49.004498 run patchelf(pid=9686): Launched 17:17:49.192441 run osmo-stp_10.42.42.5(pid=9683): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] 17:17:49.330729 run osmo-stp_10.42.42.5(pid=9683): stdout: | (launched: 2022-12-13_17:17:47.847054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:49.471150 run osmo-stp_10.42.42.5(pid=9683): stderr: | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171748044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:49.611369 run osmo-stp_10.42.42.5(pid=9683): stdout: | (launched: 2022-12-13_17:17:47.847054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:49.745863 run osmo-stp_10.42.42.5(pid=9683): stderr: | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171748043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171748044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171748044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:49.904496 run patchelf(pid=9686): Terminating (SIGINT) 17:17:50.089423 run patchelf(pid=9686): Terminated: ok {rc=0} 17:17:50.222698 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9683): Process ended prematurely: osmo-stp_10.42.42.5(pid=9683) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 17:17:50.232264 tst ping.py:22: Test FAILED (7.1 sec) 17:17:50.260817 run osmo-hlr_10.42.42.2(pid=9680): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9680)] 17:17:50.312236 run osmo-hlr_10.42.42.2(pid=9680): stdout: | (launched: 2022-12-13_17:17:46.575707) 17:17:50.365679 run osmo-hlr_10.42.42.2(pid=9680): stderr: | [0;m[1;31m20221213171746917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171746919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171746919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171746919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171746919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171746919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171746942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171746962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171746962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171746962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:50.419413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Terminating (SIGTERM) 17:17:50.461823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Terminating (SIGTERM) 17:17:50.504545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9685): Terminating (SIGTERM) 17:17:50.547612 --- ParallelTerminationStrategy: PID 9679 died... 17:17:50.568384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Terminated: ok {rc=0} 17:17:50.616168 --- ParallelTerminationStrategy: PID 9682 died... 17:17:50.636381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Terminated: ok {rc=0} 17:17:50.683995 --- ParallelTerminationStrategy: PID 9685 died... 17:17:50.704306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9685): Terminated: ok {rc=0} 17:17:50.794640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:17:51.883524 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.895469 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:51.934460 tst ping_idle_ping.py: using LAC 35076 17:17:52.064870 tst ping_idle_ping.py: using RAC 141 17:17:52.195466 tst ping_idle_ping.py: using CellId 35076 17:17:52.323690 tst ping_idle_ping.py: using BVCI 35077 17:17:52.445740 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.456827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.468046 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.479068 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.490867 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.502645 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.514787 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:52.526743 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:52.655423 tst ping_idle_ping.py:24: start network... 17:17:52.877336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:53.385918 run create_hlr_db(pid=9687): Launched 17:17:53.512364 bus /gobi_6: Setting Powered False 17:17:54.577884 run create_hlr_db(pid=9687): Terminated: ok {rc=0} 17:17:55.018976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Launched 17:17:55.328897 run osmo-hlr_10.42.42.2(pid=9690): Launched 17:17:55.446712 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:55.994944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Launched 17:17:56.303974 run osmo-stp_10.42.42.5(pid=9693): Launched 17:17:56.421512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:56.973248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Launched 17:17:57.090220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:57.351958 run patchelf(pid=9696): Launched 17:17:57.522321 run osmo-stp_10.42.42.5(pid=9693): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] 17:17:57.651832 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-13_17:17:56.245882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:57.783302 run osmo-stp_10.42.42.5(pid=9693): stderr: | [0;m[38;5;43m20221213171756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171756423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171756423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:57.914799 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-13_17:17:56.245882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:58.039986 run osmo-stp_10.42.42.5(pid=9693): stderr: | [0;m[38;5;43m20221213171756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171756423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171756423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:58.188362 run patchelf(pid=9696): Terminating (SIGINT) 17:17:58.361927 run patchelf(pid=9696): Terminated: ok {rc=0} 17:17:58.486519 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 17:17:58.495280 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:17:58.521878 run osmo-hlr_10.42.42.2(pid=9690): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9690)] 17:17:58.569914 run osmo-hlr_10.42.42.2(pid=9690): stdout: | (launched: 2022-12-13_17:17:55.270716) 17:17:58.619700 run osmo-hlr_10.42.42.2(pid=9690): stderr: | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171755449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171755461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171755470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171755470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171755470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:58.670118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminating (SIGTERM) 17:17:58.710137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminating (SIGTERM) 17:17:58.750032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Terminating (SIGTERM) 17:17:58.789952 --- ParallelTerminationStrategy: PID 9689 died... 17:17:58.809397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminated: ok {rc=0} 17:17:58.853745 --- ParallelTerminationStrategy: PID 9692 died... 17:17:58.872333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminated: ok {rc=0} 17:17:58.916387 --- ParallelTerminationStrategy: PID 9695 died... 17:17:58.935221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Terminated: ok {rc=0} 17:17:59.021368 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:18:00.307367 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:18:00.313369 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:18:00.334264 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:18:00.373607 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:18:00.461326 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:18:00.481918 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:18:00.520360 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:18:01.112814 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:18:01.164630 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.175634 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:01.232528 tst cs_paging_gprs_active.py: using LAC 35077 17:18:01.356435 tst cs_paging_gprs_active.py: using RAC 142 17:18:01.479415 tst cs_paging_gprs_active.py: using CellId 35077 17:18:01.608017 tst cs_paging_gprs_active.py: using BVCI 35078 17:18:01.749831 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.761578 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.772821 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.784298 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.796150 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.808054 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.819992 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.831759 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.844212 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:01.990983 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:02.141566 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:18:02.358792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:02.675483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Launched 17:18:02.950188 run iperf3-srv_10.42.42.10(pid=9701): Launched 17:18:03.067111 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:18:03.275920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:03.591932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Launched 17:18:03.867521 run iperf3-srv_10.42.42.10(pid=9703): Launched 17:18:03.985344 tst cs_paging_gprs_active.py:38: start network... 17:18:04.197129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:04.685335 run create_hlr_db(pid=9704): Launched 17:18:04.813731 bus /gobi_6: Setting Powered False 17:18:05.875006 run create_hlr_db(pid=9704): Terminated: ok {rc=0} 17:18:06.313597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Launched 17:18:06.629874 run osmo-hlr_10.42.42.2(pid=9707): Launched 17:18:06.751306 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:07.289630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Launched 17:18:07.604559 run osmo-stp_10.42.42.5(pid=9710): Launched 17:18:07.722998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:08.263776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Launched 17:18:08.384882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:08.651728 run patchelf(pid=9713): Launched 17:18:08.825487 run osmo-stp_10.42.42.5(pid=9710): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] 17:18:08.957641 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-13_17:18:07.545379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:09.091389 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171807718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171807720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171807721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171807721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:09.225322 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-13_17:18:07.545379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:09.352770 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171807718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171807718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171807720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171807721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171807721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:09.503889 run patchelf(pid=9713): Terminating (SIGINT) 17:18:09.680778 run patchelf(pid=9713): Terminated: ok {rc=0} 17:18:09.808498 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:18:09.817881 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:18:09.844861 run osmo-hlr_10.42.42.2(pid=9707): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9707)] 17:18:09.893115 run osmo-hlr_10.42.42.2(pid=9707): stdout: | (launched: 2022-12-13_17:18:06.570574) 17:18:09.942863 run osmo-hlr_10.42.42.2(pid=9707): stderr: | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171806754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171806767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171806778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171806778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171806778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:09.993137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminating (SIGTERM) 17:18:10.033175 run iperf3-srv_10.42.42.10(pid=9701): Terminating (SIGTERM) 17:18:10.073062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminating (SIGTERM) 17:18:10.113077 run iperf3-srv_10.42.42.10(pid=9703): Terminating (SIGTERM) 17:18:10.153111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminating (SIGTERM) 17:18:10.193070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminating (SIGTERM) 17:18:10.232881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Terminating (SIGTERM) 17:18:10.273069 --- ParallelTerminationStrategy: PID 9700 died... 17:18:10.292721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminated: ok {rc=0} 17:18:10.337340 --- ParallelTerminationStrategy: PID 9701 died... 17:18:10.356053 run iperf3-srv_10.42.42.10(pid=9701): Terminated {rc=256} 17:18:10.400252 --- ParallelTerminationStrategy: PID 9702 died... 17:18:10.419171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminated: ok {rc=0} 17:18:10.463214 --- ParallelTerminationStrategy: PID 9703 died... 17:18:10.481882 run iperf3-srv_10.42.42.10(pid=9703): Terminated {rc=256} 17:18:10.525892 --- ParallelTerminationStrategy: PID 9706 died... 17:18:10.544680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminated: ok {rc=0} 17:18:10.589051 --- ParallelTerminationStrategy: PID 9709 died... 17:18:10.607818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminated: ok {rc=0} 17:18:10.651931 --- ParallelTerminationStrategy: PID 9712 died... 17:18:10.670833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Terminated: ok {rc=0} 17:18:10.757315 bus /gobi_0: Setting Powered False 17:18:11.857806 bus /gobi_0: Setting Powered False 17:18:12.974562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:18:14.130452 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.142601 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:14.203724 tst iperf3.py: using LAC 35078 17:18:14.333596 tst iperf3.py: using RAC 143 17:18:14.465657 tst iperf3.py: using CellId 35078 17:18:14.588697 tst iperf3.py: using BVCI 35079 17:18:14.703196 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.714233 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.724857 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.735599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.746164 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.756645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.767413 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.778171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.788824 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:14.909301 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:15.136268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:15.473900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9714): Launched 17:18:15.767192 run iperf3-srv_10.42.42.10(pid=9715): Launched 17:18:15.906022 tst iperf3.py:8: start network... 17:18:16.175130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:16.703225 run create_hlr_db(pid=9716): Launched 17:18:16.870552 bus /gobi_6: Setting Powered False 17:18:17.936325 run create_hlr_db(pid=9716): Terminated: ok {rc=0} 17:18:18.383493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9718): Launched 17:18:18.698529 run osmo-hlr_10.42.42.2(pid=9719): Launched 17:18:18.817042 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:19.356329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Launched 17:18:19.670764 run osmo-stp_10.42.42.5(pid=9722): Launched 17:18:19.788786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:20.327745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9724): Launched 17:18:20.448743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:20.714429 run patchelf(pid=9725): Launched 17:18:20.888664 run osmo-stp_10.42.42.5(pid=9722): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9722)] 17:18:21.020062 run osmo-stp_10.42.42.5(pid=9722): stdout: | (launched: 2022-12-13_17:18:19.610677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:21.153296 run osmo-stp_10.42.42.5(pid=9722): stderr: | [0;m[38;5;43m20221213171819785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171819785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171819786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171819786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171819786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171819786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171819787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:21.286479 run osmo-stp_10.42.42.5(pid=9722): stdout: | (launched: 2022-12-13_17:18:19.610677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:21.413225 run osmo-stp_10.42.42.5(pid=9722): stderr: | [0;m[38;5;43m20221213171819785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171819785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171819786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171819786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171819786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171819786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171819787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:21.563631 run patchelf(pid=9725): Terminating (SIGINT) 17:18:21.740592 run patchelf(pid=9725): Terminated: ok {rc=0} 17:18:21.867489 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9722): Process ended prematurely: osmo-stp_10.42.42.5(pid=9722) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9722)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 17:18:21.876841 tst iperf3.py:8: Test FAILED (7.8 sec) 17:18:21.904041 run osmo-hlr_10.42.42.2(pid=9719): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9719)] 17:18:21.951907 run osmo-hlr_10.42.42.2(pid=9719): stdout: | (launched: 2022-12-13_17:18:18.639189) 17:18:22.001925 run osmo-hlr_10.42.42.2(pid=9719): stderr: | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171818820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171818832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171818843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171818843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171818843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:22.052232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9714): Terminating (SIGTERM) 17:18:22.092804 run iperf3-srv_10.42.42.10(pid=9715): Terminating (SIGTERM) 17:18:22.133149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9718): Terminating (SIGTERM) 17:18:22.173777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Terminating (SIGTERM) 17:18:22.214060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9724): Terminating (SIGTERM) 17:18:22.254689 --- ParallelTerminationStrategy: PID 9714 died... 17:18:22.274078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9714): Terminated: ok {rc=0} 17:18:22.318805 --- ParallelTerminationStrategy: PID 9715 died... 17:18:22.337706 run iperf3-srv_10.42.42.10(pid=9715): Terminated {rc=256} 17:18:22.382622 --- ParallelTerminationStrategy: PID 9718 died... 17:18:22.401787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9718): Terminated: ok {rc=0} 17:18:22.446450 --- ParallelTerminationStrategy: PID 9721 died... 17:18:22.465411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Terminated: ok {rc=0} 17:18:22.510409 --- ParallelTerminationStrategy: PID 9724 died... 17:18:22.529517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9724): Terminated: ok {rc=0} 17:18:22.616569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:18:23.766936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:23.778424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:23.834450 tst iperf3m4.py: using LAC 35079 17:18:23.958934 tst iperf3m4.py: using RAC 144 17:18:24.082862 tst iperf3m4.py: using CellId 35079 17:18:24.206966 tst iperf3m4.py: using BVCI 35080 17:18:24.320706 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.331722 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.342451 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.353142 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.363823 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.374448 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.385305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.396197 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.407177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.530434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.656325 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.776785 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.901305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:25.128441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:25.465831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9726): Launched 17:18:25.759257 run iperf3-srv_10.42.42.10(pid=9727): Launched 17:18:25.884092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:18:26.109924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:26.447269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9728): Launched 17:18:26.741119 run iperf3-srv_10.42.42.10(pid=9729): Launched 17:18:26.866268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:18:27.091774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:27.429105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9730): Launched 17:18:27.721678 run iperf3-srv_10.42.42.10(pid=9731): Launched 17:18:27.847227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:18:28.073375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:28.411911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9732): Launched 17:18:28.705416 run iperf3-srv_10.42.42.10(pid=9733): Launched 17:18:28.830874 tst iperf3m4.py:8: start network... 17:18:29.056935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:29.577258 run create_hlr_db(pid=9734): Launched 17:18:29.704545 bus /gobi_6: Setting Powered False 17:18:30.770399 run create_hlr_db(pid=9734): Terminated: ok {rc=0} 17:18:31.238223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9736): Launched 17:18:31.574659 run osmo-hlr_10.42.42.2(pid=9737): Launched 17:18:31.778208 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:32.541929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9739): Launched 17:18:32.855777 run osmo-stp_10.42.42.5(pid=9740): Launched 17:18:32.973251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:33.510931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9742): Launched 17:18:33.629984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:33.896548 run patchelf(pid=9743): Launched 17:18:34.070967 run osmo-stp_10.42.42.5(pid=9740): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9740)] 17:18:34.203043 run osmo-stp_10.42.42.5(pid=9740): stdout: | (launched: 2022-12-13_17:18:32.796378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:34.336062 run osmo-stp_10.42.42.5(pid=9740): stderr: | [0;m[38;5;43m20221213171832971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171832972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171832972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171832972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:34.469177 run osmo-stp_10.42.42.5(pid=9740): stdout: | (launched: 2022-12-13_17:18:32.796378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:34.596755 run osmo-stp_10.42.42.5(pid=9740): stderr: | [0;m[38;5;43m20221213171832971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171832972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171832972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171832972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171832973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:34.747504 run patchelf(pid=9743): Terminating (SIGINT) 17:18:34.924620 run patchelf(pid=9743): Terminated: ok {rc=0} 17:18:35.051745 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9740): Process ended prematurely: osmo-stp_10.42.42.5(pid=9740) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9740)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:18:35.061171 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:18:35.088660 run osmo-hlr_10.42.42.2(pid=9737): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9737)] 17:18:35.137127 run osmo-hlr_10.42.42.2(pid=9737): stdout: | (launched: 2022-12-13_17:18:31.511264) 17:18:35.187297 run osmo-hlr_10.42.42.2(pid=9737): stderr: | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171831838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171831858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171831866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171831866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171831866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:35.237755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9726): Terminating (SIGTERM) 17:18:35.277877 run iperf3-srv_10.42.42.10(pid=9727): Terminating (SIGTERM) 17:18:35.317978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9728): Terminating (SIGTERM) 17:18:35.358077 run iperf3-srv_10.42.42.10(pid=9729): Terminating (SIGTERM) 17:18:35.398056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9730): Terminating (SIGTERM) 17:18:35.438119 run iperf3-srv_10.42.42.10(pid=9731): Terminating (SIGTERM) 17:18:35.477983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9732): Terminating (SIGTERM) 17:18:35.518047 run iperf3-srv_10.42.42.10(pid=9733): Terminating (SIGTERM) 17:18:35.559320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9736): Terminating (SIGTERM) 17:18:35.600213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9739): Terminating (SIGTERM) 17:18:35.640227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9742): Terminating (SIGTERM) 17:18:35.680527 --- ParallelTerminationStrategy: PID 9726 died... 17:18:35.700070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9726): Terminated: ok {rc=0} 17:18:35.744452 --- ParallelTerminationStrategy: PID 9727 died... 17:18:35.763255 run iperf3-srv_10.42.42.10(pid=9727): Terminated {rc=256} 17:18:35.807333 --- ParallelTerminationStrategy: PID 9728 died... 17:18:35.826127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9728): Terminated: ok {rc=0} 17:18:35.870343 --- ParallelTerminationStrategy: PID 9729 died... 17:18:35.889113 run iperf3-srv_10.42.42.10(pid=9729): Terminated {rc=256} 17:18:35.933183 --- ParallelTerminationStrategy: PID 9730 died... 17:18:35.951979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9730): Terminated: ok {rc=0} 17:18:35.996256 --- ParallelTerminationStrategy: PID 9731 died... 17:18:36.014986 run iperf3-srv_10.42.42.10(pid=9731): Terminated {rc=256} 17:18:36.058978 --- ParallelTerminationStrategy: PID 9732 died... 17:18:36.077852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9732): Terminated: ok {rc=0} 17:18:36.122168 --- ParallelTerminationStrategy: PID 9733 died... 17:18:36.140998 run iperf3-srv_10.42.42.10(pid=9733): Terminated {rc=256} 17:18:36.185190 --- ParallelTerminationStrategy: PID 9736 died... 17:18:36.203971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9736): Terminated: ok {rc=0} 17:18:36.248366 --- ParallelTerminationStrategy: PID 9739 died... 17:18:36.267279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9739): Terminated: ok {rc=0} 17:18:36.311703 --- ParallelTerminationStrategy: PID 9742 died... 17:18:36.330678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9742): Terminated: ok {rc=0} 17:18:36.416002 bus /gobi_4: Setting Powered False 17:18:37.516032 bus /gobi_4: Setting Powered False 17:18:38.638476 bus /gobi_1: Setting Powered False 17:18:39.741293 bus /gobi_1: Setting Powered False 17:18:40.861640 bus /gobi_0: Setting Powered False 17:18:41.961981 bus /gobi_0: Setting Powered False 17:18:43.077189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:18:44.181151 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.193381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:44.253218 tst ping.py: using LAC 35080 17:18:44.383446 tst ping.py: using RAC 145 17:18:44.513212 tst ping.py: using CellId 35080 17:18:44.644086 tst ping.py: using BVCI 35081 17:18:44.765840 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.777343 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.788482 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.799709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.811158 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.822687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.834416 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.845956 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:44.967289 tst ping.py:19: start network... 17:18:45.188217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:45.697183 run create_hlr_db(pid=9744): Launched 17:18:45.821855 bus /gobi_6: Setting Powered False 17:18:46.886069 run create_hlr_db(pid=9744): Terminated: ok {rc=0} 17:18:47.374900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Launched 17:18:47.706062 run osmo-hlr_10.42.42.2(pid=9747): Launched 17:18:47.831105 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:48.411868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Launched 17:18:48.740706 run osmo-stp_10.42.42.5(pid=9750): Launched 17:18:48.864706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:49.430786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Launched 17:18:49.556134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:49.835747 run patchelf(pid=9753): Launched 17:18:50.017084 run osmo-stp_10.42.42.5(pid=9750): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] 17:18:50.156095 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-13_17:18:48.679468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:50.296694 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171848875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:50.437022 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-13_17:18:48.679468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:50.571678 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171848874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171848875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171848875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:50.731464 run patchelf(pid=9753): Terminating (SIGINT) 17:18:50.916126 run patchelf(pid=9753): Terminated: ok {rc=0} 17:18:51.049715 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 17:18:51.059215 tst ping.py:22: Test FAILED (6.9 sec) 17:18:51.087504 run osmo-hlr_10.42.42.2(pid=9747): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9747)] 17:18:51.138920 run osmo-hlr_10.42.42.2(pid=9747): stdout: | (launched: 2022-12-13_17:18:47.643657) 17:18:51.191593 run osmo-hlr_10.42.42.2(pid=9747): stderr: | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171847847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171847860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171847868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171847868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171847868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:51.244490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminating (SIGTERM) 17:18:51.286759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminating (SIGTERM) 17:18:51.329711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Terminating (SIGTERM) 17:18:51.372571 --- ParallelTerminationStrategy: PID 9746 died... 17:18:51.393226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminated: ok {rc=0} 17:18:51.440194 --- ParallelTerminationStrategy: PID 9749 died... 17:18:51.460197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminated: ok {rc=0} 17:18:51.507000 --- ParallelTerminationStrategy: PID 9752 died... 17:18:51.527133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Terminated: ok {rc=0} 17:18:51.616821 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:18:52.705171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.717198 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:52.776467 tst ping_idle_ping.py: using LAC 35081 17:18:52.909678 tst ping_idle_ping.py: using RAC 146 17:18:53.038277 tst ping_idle_ping.py: using CellId 35081 17:18:53.165376 tst ping_idle_ping.py: using BVCI 35082 17:18:53.284406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.295780 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.306841 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.318022 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.330018 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.341747 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.353802 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:53.365818 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:53.487279 tst ping_idle_ping.py:24: start network... 17:18:53.710370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:54.221951 run create_hlr_db(pid=9754): Launched 17:18:54.348041 bus /gobi_6: Setting Powered False 17:18:55.413655 run create_hlr_db(pid=9754): Terminated: ok {rc=0} 17:18:55.857176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Launched 17:18:56.167980 run osmo-hlr_10.42.42.2(pid=9757): Launched 17:18:56.285819 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:56.820116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Launched 17:18:57.130331 run osmo-stp_10.42.42.5(pid=9760): Launched 17:18:57.247638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:57.783265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Launched 17:18:57.900677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:58.163100 run patchelf(pid=9763): Launched 17:18:58.333257 run osmo-stp_10.42.42.5(pid=9760): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] 17:18:58.462839 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-13_17:18:57.071564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:58.593935 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171857246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:58.726109 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-13_17:18:57.071564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:58.851234 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171857245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171857246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171857246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:58.999554 run patchelf(pid=9763): Terminating (SIGINT) 17:18:59.173500 run patchelf(pid=9763): Terminated: ok {rc=0} 17:18:59.298261 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:18:59.307037 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:18:59.333759 run osmo-hlr_10.42.42.2(pid=9757): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9757)] 17:18:59.382331 run osmo-hlr_10.42.42.2(pid=9757): stdout: | (launched: 2022-12-13_17:18:56.108774) 17:18:59.431944 run osmo-hlr_10.42.42.2(pid=9757): stderr: | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171856301 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:59.481971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminating (SIGTERM) 17:18:59.522079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminating (SIGTERM) 17:18:59.562326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminating (SIGTERM) 17:18:59.602661 --- ParallelTerminationStrategy: PID 9756 died... 17:18:59.621502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminated: ok {rc=0} 17:18:59.665773 --- ParallelTerminationStrategy: PID 9759 died... 17:18:59.684502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminated: ok {rc=0} 17:18:59.728753 --- ParallelTerminationStrategy: PID 9762 died... 17:18:59.748141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminated: ok {rc=0} 17:18:59.833412 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:19:01.143122 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:19:01.149085 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:19:01.170360 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:19:01.211371 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:19:01.299814 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:19:01.322384 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:19:01.367008 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:19:02.001245 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:19:02.069412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.081982 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:02.146547 tst cs_paging_gprs_active.py: using LAC 35082 17:19:02.282431 tst cs_paging_gprs_active.py: using RAC 147 17:19:02.413287 tst cs_paging_gprs_active.py: using CellId 35082 17:19:02.542734 tst cs_paging_gprs_active.py: using BVCI 35083 17:19:02.664455 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.675822 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.687451 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.698901 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.710374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.722142 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.733859 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.745258 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.756842 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:02.876741 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:02.999974 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:19:03.226535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:03.563722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Launched 17:19:03.857065 run iperf3-srv_10.42.42.10(pid=9768): Launched 17:19:03.982510 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:19:04.208564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:04.546423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Launched 17:19:04.842551 run iperf3-srv_10.42.42.10(pid=9770): Launched 17:19:04.967844 tst cs_paging_gprs_active.py:38: start network... 17:19:05.193659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:05.713549 run create_hlr_db(pid=9771): Launched 17:19:05.841808 bus /gobi_6: Setting Powered False 17:19:06.907922 run create_hlr_db(pid=9771): Terminated: ok {rc=0} 17:19:07.355593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Launched 17:19:07.671881 run osmo-hlr_10.42.42.2(pid=9774): Launched 17:19:07.791015 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:08.346243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Launched 17:19:08.661372 run osmo-stp_10.42.42.5(pid=9777): Launched 17:19:08.781140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:09.322153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Launched 17:19:09.441774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:09.707321 run patchelf(pid=9780): Launched 17:19:09.881286 run osmo-stp_10.42.42.5(pid=9777): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] 17:19:10.013606 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-13_17:19:08.602079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.147256 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171908780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.281234 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-13_17:19:08.602079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.408583 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171908779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171908780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171908780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.559728 run patchelf(pid=9780): Terminating (SIGINT) 17:19:10.736493 run patchelf(pid=9780): Terminated: ok {rc=0} 17:19:10.865556 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:19:10.875116 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:19:10.902378 run osmo-hlr_10.42.42.2(pid=9774): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9774)] 17:19:10.950497 run osmo-hlr_10.42.42.2(pid=9774): stdout: | (launched: 2022-12-13_17:19:07.612195) 17:19:11.000199 run osmo-hlr_10.42.42.2(pid=9774): stderr: | [0;m[1;31m20221213171907791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171907791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171907791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171907791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171907791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171907792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171907804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171907812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171907812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171907812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:11.050500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminating (SIGTERM) 17:19:11.090540 run iperf3-srv_10.42.42.10(pid=9768): Terminating (SIGTERM) 17:19:11.130423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminating (SIGTERM) 17:19:11.170660 run iperf3-srv_10.42.42.10(pid=9770): Terminating (SIGTERM) 17:19:11.210502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminating (SIGTERM) 17:19:11.250517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminating (SIGTERM) 17:19:11.290464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Terminating (SIGTERM) 17:19:11.330754 --- ParallelTerminationStrategy: PID 9767 died... 17:19:11.350246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminated: ok {rc=0} 17:19:11.395041 --- ParallelTerminationStrategy: PID 9768 died... 17:19:11.414033 run iperf3-srv_10.42.42.10(pid=9768): Terminated {rc=256} 17:19:11.458325 --- ParallelTerminationStrategy: PID 9769 died... 17:19:11.477292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminated: ok {rc=0} 17:19:11.521471 --- ParallelTerminationStrategy: PID 9770 died... 17:19:11.540127 run iperf3-srv_10.42.42.10(pid=9770): Terminated {rc=256} 17:19:11.584381 --- ParallelTerminationStrategy: PID 9773 died... 17:19:11.603177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminated: ok {rc=0} 17:19:11.647297 --- ParallelTerminationStrategy: PID 9776 died... 17:19:11.666093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminated: ok {rc=0} 17:19:11.710301 --- ParallelTerminationStrategy: PID 9779 died... 17:19:11.729164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Terminated: ok {rc=0} 17:19:11.815788 bus /gobi_0: Setting Powered False 17:19:12.916741 bus /gobi_0: Setting Powered False 17:19:14.029450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:19:15.181858 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.193932 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:15.255854 tst iperf3.py: using LAC 35083 17:19:15.387706 tst iperf3.py: using RAC 148 17:19:15.520685 tst iperf3.py: using CellId 35083 17:19:15.650567 tst iperf3.py: using BVCI 35084 17:19:15.773976 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.785392 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.796561 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.807723 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.819121 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.831436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.845106 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.857890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.870624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:16.021884 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:16.253366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:16.599314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9782): Launched 17:19:16.945276 run iperf3-srv_10.42.42.10(pid=9783): Launched 17:19:17.115254 tst iperf3.py:8: start network... 17:19:17.344705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:17.863601 run create_hlr_db(pid=9784): Launched 17:19:17.990306 bus /gobi_6: Setting Powered False 17:19:19.055682 run create_hlr_db(pid=9784): Terminated: ok {rc=0} 17:19:19.521078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Launched 17:19:19.857420 run osmo-hlr_10.42.42.2(pid=9787): Launched 17:19:19.985237 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:20.565165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Launched 17:19:20.901594 run osmo-stp_10.42.42.5(pid=9790): Launched 17:19:21.030224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:21.610773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Launched 17:19:21.739253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:22.024163 run patchelf(pid=9793): Launched 17:19:22.210269 run osmo-stp_10.42.42.5(pid=9790): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] 17:19:22.351871 run osmo-stp_10.42.42.5(pid=9790): stdout: | (launched: 2022-12-13_17:19:20.838804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:22.494962 run osmo-stp_10.42.42.5(pid=9790): stderr: | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171921037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:22.638233 run osmo-stp_10.42.42.5(pid=9790): stdout: | (launched: 2022-12-13_17:19:20.838804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:22.775436 run osmo-stp_10.42.42.5(pid=9790): stderr: | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171921036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171921037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171921037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:22.937852 run patchelf(pid=9793): Terminating (SIGINT) 17:19:23.128004 run patchelf(pid=9793): Terminated: ok {rc=0} 17:19:23.264658 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9790): Process ended prematurely: osmo-stp_10.42.42.5(pid=9790) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 17:19:23.274966 tst iperf3.py:8: Test FAILED (8.1 sec) 17:19:23.303716 run osmo-hlr_10.42.42.2(pid=9787): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9787)] 17:19:23.355711 run osmo-hlr_10.42.42.2(pid=9787): stdout: | (launched: 2022-12-13_17:19:19.794317) 17:19:23.408852 run osmo-hlr_10.42.42.2(pid=9787): stderr: | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171919997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171920011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171920021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171920021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171920021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:23.462468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9782): Terminating (SIGTERM) 17:19:23.505046 run iperf3-srv_10.42.42.10(pid=9783): Terminating (SIGTERM) 17:19:23.547853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Terminating (SIGTERM) 17:19:23.590728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Terminating (SIGTERM) 17:19:23.633552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Terminating (SIGTERM) 17:19:23.676612 --- ParallelTerminationStrategy: PID 9782 died... 17:19:23.697743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9782): Terminated: ok {rc=0} 17:19:23.745509 --- ParallelTerminationStrategy: PID 9783 died... 17:19:23.765702 run iperf3-srv_10.42.42.10(pid=9783): Terminated {rc=256} 17:19:23.812919 --- ParallelTerminationStrategy: PID 9786 died... 17:19:23.833230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Terminated: ok {rc=0} 17:19:23.880465 --- ParallelTerminationStrategy: PID 9789 died... 17:19:23.900882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Terminated: ok {rc=0} 17:19:23.948057 --- ParallelTerminationStrategy: PID 9792 died... 17:19:23.968299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Terminated: ok {rc=0} 17:19:24.058260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:19:25.207952 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.219660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:25.277201 tst iperf3m4.py: using LAC 35084 17:19:25.401612 tst iperf3m4.py: using RAC 149 17:19:25.524569 tst iperf3m4.py: using CellId 35084 17:19:25.648816 tst iperf3m4.py: using BVCI 35085 17:19:25.764125 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.775181 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.785815 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.796577 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.807339 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.818229 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.829168 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.839969 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.850890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.969461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.095439 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.215039 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:26.338468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:26.563920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:26.900655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9794): Launched 17:19:27.194682 run iperf3-srv_10.42.42.10(pid=9795): Launched 17:19:27.319408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:19:27.543940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:27.880512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9796): Launched 17:19:28.172335 run iperf3-srv_10.42.42.10(pid=9797): Launched 17:19:28.296939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:19:28.521304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:28.858257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9798): Launched 17:19:29.150337 run iperf3-srv_10.42.42.10(pid=9799): Launched 17:19:29.275150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:19:29.499649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:29.837164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Launched 17:19:30.129113 run iperf3-srv_10.42.42.10(pid=9801): Launched 17:19:30.253846 tst iperf3m4.py:8: start network... 17:19:30.478470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:31.007002 run create_hlr_db(pid=9802): Launched 17:19:31.148375 bus /gobi_6: Setting Powered False 17:19:32.213586 run create_hlr_db(pid=9802): Terminated: ok {rc=0} 17:19:32.683425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9804): Launched 17:19:33.021507 run osmo-hlr_10.42.42.2(pid=9805): Launched 17:19:33.150219 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:33.738696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9807): Launched 17:19:34.075659 run osmo-stp_10.42.42.5(pid=9808): Launched 17:19:34.203645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:34.782107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9810): Launched 17:19:34.910297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:35.195949 run patchelf(pid=9811): Launched 17:19:35.382282 run osmo-stp_10.42.42.5(pid=9808): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9808)] 17:19:35.524137 run osmo-stp_10.42.42.5(pid=9808): stdout: | (launched: 2022-12-13_17:19:34.012595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:35.667398 run osmo-stp_10.42.42.5(pid=9808): stderr: | [0;m[38;5;43m20221213171934207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171934208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171934208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171934208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:35.811129 run osmo-stp_10.42.42.5(pid=9808): stdout: | (launched: 2022-12-13_17:19:34.012595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:35.947852 run osmo-stp_10.42.42.5(pid=9808): stderr: | [0;m[38;5;43m20221213171934207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171934208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171934208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171934208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171934209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:36.110379 run patchelf(pid=9811): Terminating (SIGINT) 17:19:36.299583 run patchelf(pid=9811): Terminated: ok {rc=0} 17:19:36.435887 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9808): Process ended prematurely: osmo-stp_10.42.42.5(pid=9808) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9808)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:19:36.446725 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:19:36.475620 run osmo-hlr_10.42.42.2(pid=9805): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9805)] 17:19:36.527389 run osmo-hlr_10.42.42.2(pid=9805): stdout: | (launched: 2022-12-13_17:19:32.958251) 17:19:36.580314 run osmo-hlr_10.42.42.2(pid=9805): stderr: | [0;m[1;31m20221213171933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171933163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171933176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171933184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171933184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171933184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:36.633699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9794): Terminating (SIGTERM) 17:19:36.676111 run iperf3-srv_10.42.42.10(pid=9795): Terminating (SIGTERM) 17:19:36.719779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9796): Terminating (SIGTERM) 17:19:36.762911 run iperf3-srv_10.42.42.10(pid=9797): Terminating (SIGTERM) 17:19:36.805628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9798): Terminating (SIGTERM) 17:19:36.848510 run iperf3-srv_10.42.42.10(pid=9799): Terminating (SIGTERM) 17:19:36.891313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Terminating (SIGTERM) 17:19:36.934215 run iperf3-srv_10.42.42.10(pid=9801): Terminating (SIGTERM) 17:19:36.976883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9804): Terminating (SIGTERM) 17:19:37.020156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9807): Terminating (SIGTERM) 17:19:37.063035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9810): Terminating (SIGTERM) 17:19:37.106143 --- ParallelTerminationStrategy: PID 9794 died... 17:19:37.127010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9794): Terminated: ok {rc=0} 17:19:37.174470 --- ParallelTerminationStrategy: PID 9795 died... 17:19:37.194623 run iperf3-srv_10.42.42.10(pid=9795): Terminated {rc=256} 17:19:37.241645 --- ParallelTerminationStrategy: PID 9796 died... 17:19:37.261906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9796): Terminated: ok {rc=0} 17:19:37.309244 --- ParallelTerminationStrategy: PID 9797 died... 17:19:37.329490 run iperf3-srv_10.42.42.10(pid=9797): Terminated {rc=256} 17:19:37.376737 --- ParallelTerminationStrategy: PID 9798 died... 17:19:37.397061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9798): Terminated: ok {rc=0} 17:19:37.444285 --- ParallelTerminationStrategy: PID 9799 died... 17:19:37.464565 run iperf3-srv_10.42.42.10(pid=9799): Terminated {rc=256} 17:19:37.511581 --- ParallelTerminationStrategy: PID 9800 died... 17:19:37.531746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Terminated: ok {rc=0} 17:19:37.578938 --- ParallelTerminationStrategy: PID 9801 died... 17:19:37.599213 run iperf3-srv_10.42.42.10(pid=9801): Terminated {rc=256} 17:19:37.646425 --- ParallelTerminationStrategy: PID 9804 died... 17:19:37.666818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9804): Terminated: ok {rc=0} 17:19:37.714651 --- ParallelTerminationStrategy: PID 9807 died... 17:19:37.734959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9807): Terminated: ok {rc=0} 17:19:37.782309 --- ParallelTerminationStrategy: PID 9810 died... 17:19:37.802718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9810): Terminated: ok {rc=0} 17:19:37.893156 bus /gobi_4: Setting Powered False 17:19:38.994411 bus /gobi_4: Setting Powered False 17:19:40.114606 bus /gobi_1: Setting Powered False 17:19:41.215292 bus /gobi_1: Setting Powered False 17:19:42.332713 bus /gobi_0: Setting Powered False 17:19:43.432884 bus /gobi_0: Setting Powered False 17:19:44.552106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:19:45.657476 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:45.669619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:45.729791 tst ping.py: using LAC 35085 17:19:45.861045 tst ping.py: using RAC 150 17:19:46.013249 tst ping.py: using CellId 35085 17:19:46.171284 tst ping.py: using BVCI 35086 17:19:46.301127 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.312906 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.325293 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.338862 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.351611 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.364850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.377942 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:46.391217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:46.516764 tst ping.py:19: start network... 17:19:46.746370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:47.266476 run create_hlr_db(pid=9812): Launched 17:19:47.392548 bus /gobi_6: Setting Powered False 17:19:48.457442 run create_hlr_db(pid=9812): Terminated: ok {rc=0} 17:19:48.916407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Launched 17:19:49.246543 run osmo-hlr_10.42.42.2(pid=9815): Launched 17:19:49.372680 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:49.942558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Launched 17:19:50.272651 run osmo-stp_10.42.42.5(pid=9818): Launched 17:19:50.398339 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:50.964846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Launched 17:19:51.090200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:51.369312 run patchelf(pid=9821): Launched 17:19:51.551302 run osmo-stp_10.42.42.5(pid=9818): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] 17:19:51.690362 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-13_17:19:50.210830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:51.831727 run osmo-stp_10.42.42.5(pid=9818): stderr: | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171950406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:51.972552 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-13_17:19:50.210830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:52.106829 run osmo-stp_10.42.42.5(pid=9818): stderr: | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171950405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171950406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171950408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:52.266110 run patchelf(pid=9821): Terminating (SIGINT) 17:19:52.451721 run patchelf(pid=9821): Terminated: ok {rc=0} 17:19:52.585388 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 17:19:52.594946 tst ping.py:22: Test FAILED (6.9 sec) 17:19:52.623486 run osmo-hlr_10.42.42.2(pid=9815): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9815)] 17:19:52.675492 run osmo-hlr_10.42.42.2(pid=9815): stdout: | (launched: 2022-12-13_17:19:49.184577) 17:19:52.729325 run osmo-hlr_10.42.42.2(pid=9815): stderr: | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171949405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171949417 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171949425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171949425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171949425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:52.783194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminating (SIGTERM) 17:19:52.825732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminating (SIGTERM) 17:19:52.868629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminating (SIGTERM) 17:19:52.911683 --- ParallelTerminationStrategy: PID 9814 died... 17:19:52.932410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminated: ok {rc=0} 17:19:52.979739 --- ParallelTerminationStrategy: PID 9817 died... 17:19:52.999902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminated: ok {rc=0} 17:19:53.047066 --- ParallelTerminationStrategy: PID 9820 died... 17:19:53.067359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminated: ok {rc=0} 17:19:53.157214 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:19:54.248843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.260903 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:54.321336 tst ping_idle_ping.py: using LAC 35086 17:19:54.451916 tst ping_idle_ping.py: using RAC 151 17:19:54.574221 tst ping_idle_ping.py: using CellId 35086 17:19:54.695395 tst ping_idle_ping.py: using BVCI 35087 17:19:54.818096 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.829606 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.840600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.851914 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.863525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.875218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.887005 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:54.898573 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:55.017721 tst ping_idle_ping.py:24: start network... 17:19:55.226341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:55.706467 run create_hlr_db(pid=9822): Launched 17:19:55.831309 bus /gobi_6: Setting Powered False 17:19:56.892753 run create_hlr_db(pid=9822): Terminated: ok {rc=0} 17:19:57.346386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Launched 17:19:57.680323 run osmo-hlr_10.42.42.2(pid=9825): Launched 17:19:57.806646 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:58.378610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Launched 17:19:58.708459 run osmo-stp_10.42.42.5(pid=9828): Launched 17:19:58.836285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:59.407012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Launched 17:19:59.533037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:59.814248 run patchelf(pid=9831): Launched 17:19:59.998871 run osmo-stp_10.42.42.5(pid=9828): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] 17:20:00.138330 run osmo-stp_10.42.42.5(pid=9828): stdout: | (launched: 2022-12-13_17:19:58.646802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:00.280002 run osmo-stp_10.42.42.5(pid=9828): stderr: | [0;m[38;5;43m20221213171958840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171958840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171958841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171958841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171958843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171958844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171958844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:00.421643 run osmo-stp_10.42.42.5(pid=9828): stdout: | (launched: 2022-12-13_17:19:58.646802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:00.556240 run osmo-stp_10.42.42.5(pid=9828): stderr: | [0;m[38;5;43m20221213171958840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213171958840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213171958841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213171958841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213171958843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213171958844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213171958844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:00.716690 run patchelf(pid=9831): Terminating (SIGINT) 17:20:00.917488 run patchelf(pid=9831): Terminated: ok {rc=0} 17:20:01.054200 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9828): Process ended prematurely: osmo-stp_10.42.42.5(pid=9828) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:20:01.067699 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:20:01.097704 run osmo-hlr_10.42.42.2(pid=9825): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9825)] 17:20:01.153678 run osmo-hlr_10.42.42.2(pid=9825): stdout: | (launched: 2022-12-13_17:19:57.617704) 17:20:01.209762 run osmo-hlr_10.42.42.2(pid=9825): stderr: | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213171957819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213171957832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213171957840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213171957840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213171957840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:01.266466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Terminating (SIGTERM) 17:20:01.311330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Terminating (SIGTERM) 17:20:01.358392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Terminating (SIGTERM) 17:20:01.404317 --- ParallelTerminationStrategy: PID 9824 died... 17:20:01.427439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Terminated: ok {rc=0} 17:20:01.495944 --- ParallelTerminationStrategy: PID 9827 died... 17:20:01.519368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Terminated: ok {rc=0} 17:20:01.569045 --- ParallelTerminationStrategy: PID 9830 died... 17:20:01.591381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Terminated: ok {rc=0} 17:20:01.684112 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:20:02.982329 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:02.989762 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:20:03.011220 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:20:03.048196 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:20:03.104902 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:20:03.126653 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:20:03.162530 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:20:03.714783 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:20:03.720184 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:03.731555 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:20:03.787143 tst switch_tch_pdch.py: using LAC 35087 17:20:03.909383 tst switch_tch_pdch.py: using RAC 152 17:20:04.028417 tst switch_tch_pdch.py: using CellId 35087 17:20:04.149881 tst switch_tch_pdch.py: using BVCI 35088 17:20:04.260131 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.271499 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.282619 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.293678 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.304629 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.315550 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.327022 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:04.338406 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:04.461374 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:04.580843 tst switch_tch_pdch.py:51: start network... 17:20:04.785974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:05.261282 run create_hlr_db(pid=9838): Launched 17:20:05.386915 bus /gobi_6: Setting Powered False 17:20:06.447726 run create_hlr_db(pid=9838): Terminated: ok {rc=0} 17:20:06.897371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Launched 17:20:07.226736 run osmo-hlr_10.42.42.2(pid=9841): Launched 17:20:07.351482 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:07.919902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Launched 17:20:08.248008 run osmo-stp_10.42.42.5(pid=9844): Launched 17:20:08.372113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:08.939228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Launched 17:20:09.065751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:09.344550 run patchelf(pid=9847): Launched 17:20:09.526286 run osmo-stp_10.42.42.5(pid=9844): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] 17:20:09.664598 run osmo-stp_10.42.42.5(pid=9844): stdout: | (launched: 2022-12-13_17:20:08.186311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:09.805251 run osmo-stp_10.42.42.5(pid=9844): stderr: | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172008380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:09.945682 run osmo-stp_10.42.42.5(pid=9844): stdout: | (launched: 2022-12-13_17:20:08.186311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:10.079736 run osmo-stp_10.42.42.5(pid=9844): stderr: | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172008380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172008380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172008383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:10.238735 run patchelf(pid=9847): Terminating (SIGINT) 17:20:10.425354 run patchelf(pid=9847): Terminated: ok {rc=0} 17:20:10.559447 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9844): Process ended prematurely: osmo-stp_10.42.42.5(pid=9844) [trial-2392↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] [trial-2392↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:20:10.568811 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:20:10.597209 run osmo-hlr_10.42.42.2(pid=9841): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9841)] 17:20:10.649206 run osmo-hlr_10.42.42.2(pid=9841): stdout: | (launched: 2022-12-13_17:20:07.164830) 17:20:10.702131 run osmo-hlr_10.42.42.2(pid=9841): stderr: | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172007368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172007380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172007388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172007389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172007389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:10.755554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Terminating (SIGTERM) 17:20:10.798047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Terminating (SIGTERM) 17:20:10.840752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Terminating (SIGTERM) 17:20:10.883587 --- ParallelTerminationStrategy: PID 9840 died... 17:20:10.904200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Terminated: ok {rc=0} 17:20:10.951587 --- ParallelTerminationStrategy: PID 9843 died... 17:20:10.971878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Terminated: ok {rc=0} 17:20:11.019051 --- ParallelTerminationStrategy: PID 9846 died... 17:20:11.039181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Terminated: ok {rc=0} 17:20:11.128210 bus /gobi_0: Setting Powered False 17:20:12.228556 bus /gobi_0: Setting Powered False 17:20:13.345375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:20:14.583862 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:14.590635 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:20:14.611367 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:20:14.646016 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:20:14.698135 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:20:14.718944 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:20:14.753580 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:20:15.312299 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:20:15.318637 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.330283 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:20:15.389993 tst switch_tch_pdch.py: using LAC 35088 17:20:15.515371 tst switch_tch_pdch.py: using RAC 153 17:20:15.635724 tst switch_tch_pdch.py: using CellId 35088 17:20:15.755883 tst switch_tch_pdch.py: using BVCI 35089 17:20:15.883999 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.896032 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.908088 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.919877 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.931667 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.943125 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.954916 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:15.967367 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:16.120721 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:16.266663 tst switch_tch_pdch.py:51: start network... 17:20:16.515176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:17.013871 run create_hlr_db(pid=9851): Launched 17:20:17.155446 bus /gobi_6: Setting Powered False 17:20:18.220573 run create_hlr_db(pid=9851): Terminated: ok {rc=0} 17:20:18.652035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Launched 17:20:18.980504 run osmo-hlr_10.42.42.2(pid=9854): Launched 17:20:19.105089 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:19.644772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Launched 17:20:19.974555 run osmo-stp_10.42.42.5(pid=9857): Launched 17:20:20.099417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:20.638376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Launched 17:20:20.765487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:21.044774 run patchelf(pid=9860): Launched 17:20:21.226825 run osmo-stp_10.42.42.5(pid=9857): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] 17:20:21.365889 run osmo-stp_10.42.42.5(pid=9857): stdout: | (launched: 2022-12-13_17:20:19.912769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:21.507030 run osmo-stp_10.42.42.5(pid=9857): stderr: | [0;m[38;5;43m20221213172020106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172020106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172020107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172020107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172020107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172020108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172020108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:21.648120 run osmo-stp_10.42.42.5(pid=9857): stdout: | (launched: 2022-12-13_17:20:19.912769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:21.783096 run osmo-stp_10.42.42.5(pid=9857): stderr: | [0;m[38;5;43m20221213172020106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172020106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172020107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172020107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172020107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172020108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172020108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:21.942782 run patchelf(pid=9860): Terminating (SIGINT) 17:20:22.128000 run patchelf(pid=9860): Terminated: ok {rc=0} 17:20:22.261381 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9857): Process ended prematurely: osmo-stp_10.42.42.5(pid=9857) [trial-2392↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] [trial-2392↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:20:22.271087 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 17:20:22.299611 run osmo-hlr_10.42.42.2(pid=9854): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9854)] 17:20:22.351376 run osmo-hlr_10.42.42.2(pid=9854): stdout: | (launched: 2022-12-13_17:20:18.919126) 17:20:22.404450 run osmo-hlr_10.42.42.2(pid=9854): stderr: | [0;m[1;31m20221213172019120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172019120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172019121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172019121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172019121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172019121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172019133 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172019141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172019142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172019142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:22.457743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Terminating (SIGTERM) 17:20:22.500097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Terminating (SIGTERM) 17:20:22.542816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Terminating (SIGTERM) 17:20:22.585830 --- ParallelTerminationStrategy: PID 9853 died... 17:20:22.606409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Terminated: ok {rc=0} 17:20:22.653771 --- ParallelTerminationStrategy: PID 9856 died... 17:20:22.674014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Terminated: ok {rc=0} 17:20:22.721497 --- ParallelTerminationStrategy: PID 9859 died... 17:20:22.741720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Terminated: ok {rc=0} 17:20:22.831747 bus /gobi_0: Setting Powered False 17:20:23.931966 bus /gobi_0: Setting Powered False 17:20:25.049514 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:oc2g --------------------------------------------------------------------- 17:20:26.290735 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:26.294898 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:26.316039 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:26.323021 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:26.377061 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:26.398234 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:26.405553 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:26.943045 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:26.948494 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 17:20:26.959695 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 17:20:26.995036 tst mo_mt_sms.py: using LAC 35089 17:20:27.117454 tst mo_mt_sms.py: using RAC 154 17:20:27.248074 tst mo_mt_sms.py: using CellId 35089 17:20:27.375956 tst mo_mt_sms.py: using BVCI 35090 17:20:27.495784 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:27.614639 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:27.735236 tst mo_mt_sms.py:9: start nitb and bts... 17:20:27.957580 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:28.626454 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9867): Launched 17:20:28.959873 run osmo-nitb_10.42.42.2(pid=9868): Launched 17:20:29.140940 run osmo-nitb_10.42.42.2(pid=9868): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9868)] 17:20:29.287574 run osmo-nitb_10.42.42.2(pid=9868): stdout: | (launched: 2022-12-13_17:20:28.897972) 17:20:29.436513 run osmo-nitb_10.42.42.2(pid=9868): stderr: | (launched: 2022-12-13_17:20:28.946872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:29.584697 run osmo-nitb_10.42.42.2(pid=9868): stdout: | (launched: 2022-12-13_17:20:28.897972) 17:20:29.727116 run osmo-nitb_10.42.42.2(pid=9868): stderr: | (launched: 2022-12-13_17:20:28.946872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9868): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9868) [trial-2392↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9868)] 17:20:30.083224 tst osmo-nitb_10.42.42.2(pid=9868): stdout: | (launched: 2022-12-13_17:20:28.897972) 17:20:30.216406 tst osmo-nitb_10.42.42.2(pid=9868): stderr: | (launched: 2022-12-13_17:20:28.946872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:30.372862 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9868): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9868) [trial-2392↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9868)] [trial-2392↪nitb_sms:oc2g↪mo_mt_sms.py:11] 17:20:30.382029 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:20:30.389305 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9867): Terminating (SIGTERM) 17:20:30.601090 --- ParallelTerminationStrategy: PID 9867 died... 17:20:30.622828 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9867): Terminated: ok {rc=0} 17:20:30.712815 bus /sierra_3: Setting Powered False 17:20:31.814419 bus /sierra_3: Setting Powered False 17:20:32.932740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:oc2g --------------------------------------------------------------------- 17:20:34.117854 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:34.122298 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:34.143348 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:34.171834 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:34.227742 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:34.250466 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:34.278313 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:34.816789 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:34.822022 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:34.832464 tst sms:oc2g: Using 1 x bts (candidates: 1) 17:20:34.869381 tst mo_mt_sms.py: using LAC 35090 17:20:34.997854 tst mo_mt_sms.py: using RAC 155 17:20:35.126688 tst mo_mt_sms.py: using CellId 35090 17:20:35.254689 tst mo_mt_sms.py: using BVCI 35091 17:20:35.374055 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:35.385070 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:35.395820 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:35.406654 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:35.417878 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:35.429139 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:35.551493 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:35.668814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:36.145344 run create_hlr_db(pid=9873): Launched 17:20:36.269815 bus /sierra_2: Setting Powered False 17:20:37.331287 run create_hlr_db(pid=9873): Terminated: ok {rc=0} 17:20:37.782123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9875): Launched 17:20:38.113705 run osmo-hlr_10.42.42.2(pid=9876): Launched 17:20:38.238317 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:38.808561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9878): Launched 17:20:39.138528 run osmo-stp_10.42.42.5(pid=9879): Launched 17:20:39.265338 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:39.862164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9881): Launched 17:20:40.192264 run osmo-msc_10.42.42.6(pid=9882): Launched 17:20:40.375575 run osmo-stp_10.42.42.5(pid=9879): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9879)] 17:20:40.515231 run osmo-stp_10.42.42.5(pid=9879): stdout: | (launched: 2022-12-13_17:20:39.075651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:40.654910 run osmo-stp_10.42.42.5(pid=9879): stderr: | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172039271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:40.793742 run osmo-stp_10.42.42.5(pid=9879): stdout: | (launched: 2022-12-13_17:20:39.075651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:40.924894 run osmo-stp_10.42.42.5(pid=9879): stderr: | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172039270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172039271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172039271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:41.081398 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9879): Process ended prematurely: osmo-stp_10.42.42.5(pid=9879) [trial-2392↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9879)] [trial-2392↪sms:oc2g↪mo_mt_sms.py:16] 17:20:41.090267 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 17:20:41.117875 run osmo-hlr_10.42.42.2(pid=9876): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9876)] 17:20:41.169274 run osmo-hlr_10.42.42.2(pid=9876): stdout: | (launched: 2022-12-13_17:20:38.051970) 17:20:41.222144 run osmo-hlr_10.42.42.2(pid=9876): stderr: | [0;m[1;31m20221213172038253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172038253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172038253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172038253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172038254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172038254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172038267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172038277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172038277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172038277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:41.295786 run osmo-msc_10.42.42.6(pid=9882): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9882)] 17:20:41.346688 run osmo-msc_10.42.42.6(pid=9882): stdout: | (launched: 2022-12-13_17:20:40.130198) 17:20:41.400073 run osmo-msc_10.42.42.6(pid=9882): stderr: | [0;m[38;5;43m20221213172040457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172040457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f57f3d6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172040457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172040457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172040457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172040457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172040459 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172040459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172040460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172040460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:41.453454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9875): Terminating (SIGTERM) 17:20:41.495670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9878): Terminating (SIGTERM) 17:20:41.538585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9881): Terminating (SIGTERM) 17:20:41.581721 --- ParallelTerminationStrategy: PID 9875 died... 17:20:41.602478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9875): Terminated: ok {rc=0} 17:20:41.649836 --- ParallelTerminationStrategy: PID 9878 died... 17:20:41.670055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9878): Terminated: ok {rc=0} 17:20:41.717264 --- ParallelTerminationStrategy: PID 9881 died... 17:20:41.737936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9881): Terminated: ok {rc=0} 17:20:41.827658 bus /sierra_3: Setting Powered False 17:20:42.928276 bus /sierra_3: Setting Powered False 17:20:44.047326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:oc2g --------------------------------------------------------------------- 17:20:45.270964 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:45.274923 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:45.296091 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:45.303138 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:45.339995 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:45.361215 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:45.367966 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:45.903790 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:45.916810 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 17:20:45.935126 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:45.984440 tst assert_extension.py: using LAC 35091 17:20:46.110825 tst assert_extension.py: using RAC 156 17:20:46.277237 tst assert_extension.py: using CellId 35091 17:20:46.406445 tst assert_extension.py: using BVCI 35092 17:20:46.523179 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:46.666212 tst assert_extension.py:10: start nitb and bts... 17:20:46.934206 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:47.611489 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9887): Launched 17:20:47.941175 run osmo-nitb_10.42.42.2(pid=9888): Launched 17:20:48.121995 run osmo-nitb_10.42.42.2(pid=9888): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9888)] 17:20:48.268925 run osmo-nitb_10.42.42.2(pid=9888): stdout: | (launched: 2022-12-13_17:20:47.879381) 17:20:48.417401 run osmo-nitb_10.42.42.2(pid=9888): stderr: | (launched: 2022-12-13_17:20:47.927803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:48.566245 run osmo-nitb_10.42.42.2(pid=9888): stdout: | (launched: 2022-12-13_17:20:47.879381) 17:20:48.708426 run osmo-nitb_10.42.42.2(pid=9888): stderr: | (launched: 2022-12-13_17:20:47.927803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9888): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9888) [trial-2392↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9888)] 17:20:49.064088 tst osmo-nitb_10.42.42.2(pid=9888): stdout: | (launched: 2022-12-13_17:20:47.879381) 17:20:49.196784 tst osmo-nitb_10.42.42.2(pid=9888): stderr: | (launched: 2022-12-13_17:20:47.927803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:49.353680 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9888): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9888) [trial-2392↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9888)] [trial-2392↪nitb_ussd:oc2g↪assert_extension.py:12] 17:20:49.362621 tst assert_extension.py:12: Test FAILED (3.4 sec) 17:20:49.369837 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9887): Terminating (SIGTERM) 17:20:49.581536 --- ParallelTerminationStrategy: PID 9887 died... 17:20:49.603252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9887): Terminated: ok {rc=0} 17:20:49.693639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:oc2g --------------------------------------------------------------------- 17:20:50.854610 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:50.858943 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:50.880165 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:50.908698 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:50.943779 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:50.965265 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:50.992754 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:51.520822 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:51.526280 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:51.536804 tst ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:51.569207 tst assert_extension.py: using LAC 35092 17:20:51.688713 tst assert_extension.py: using RAC 157 17:20:51.807376 tst assert_extension.py: using CellId 35092 17:20:51.927103 tst assert_extension.py: using BVCI 35093 17:20:52.037238 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:52.047598 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:52.057972 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:52.068170 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:52.078557 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:52.088770 tst ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:52.206210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:52.682998 run create_hlr_db(pid=9895): Launched 17:20:52.807409 bus /sierra_2: Setting Powered False 17:20:53.869668 run create_hlr_db(pid=9895): Terminated: ok {rc=0} 17:20:54.320279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9897): Launched 17:20:54.650523 run osmo-hlr_10.42.42.2(pid=9898): Launched 17:20:54.777488 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:55.352288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9900): Launched 17:20:55.681983 run osmo-stp_10.42.42.5(pid=9901): Launched 17:20:55.809920 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:56.405738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9903): Launched 17:20:56.735290 run osmo-msc_10.42.42.6(pid=9904): Launched 17:20:56.919453 run osmo-stp_10.42.42.5(pid=9901): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9901)] 17:20:57.059736 run osmo-stp_10.42.42.5(pid=9901): stdout: | (launched: 2022-12-13_17:20:55.619677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:57.200160 run osmo-stp_10.42.42.5(pid=9901): stderr: | [0;m[38;5;43m20221213172055817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172055817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172055818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172055818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:57.337532 run osmo-stp_10.42.42.5(pid=9901): stdout: | (launched: 2022-12-13_17:20:55.619677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:57.468332 run osmo-stp_10.42.42.5(pid=9901): stderr: | [0;m[38;5;43m20221213172055817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172055817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172055818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172055818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172055819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:57.624847 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9901): Process ended prematurely: osmo-stp_10.42.42.5(pid=9901) [trial-2392↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9901)] [trial-2392↪ussd:oc2g↪assert_extension.py:17] 17:20:57.634035 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:20:57.662015 run osmo-hlr_10.42.42.2(pid=9898): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9898)] 17:20:57.713507 run osmo-hlr_10.42.42.2(pid=9898): stdout: | (launched: 2022-12-13_17:20:54.588383) 17:20:57.766280 run osmo-hlr_10.42.42.2(pid=9898): stderr: | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172054791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172054815 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172054825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172054825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172054825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:57.839660 run osmo-msc_10.42.42.6(pid=9904): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9904)] 17:20:57.889957 run osmo-msc_10.42.42.6(pid=9904): stdout: | (launched: 2022-12-13_17:20:56.673381) 17:20:57.942331 run osmo-msc_10.42.42.6(pid=9904): stderr: | [0;m[38;5;43m20221213172056997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172056997 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c80d7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172056998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172056998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172056998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172056998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172057000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172057000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172057000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172057000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:57.995222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9897): Terminating (SIGTERM) 17:20:58.037875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9900): Terminating (SIGTERM) 17:20:58.080537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9903): Terminating (SIGTERM) 17:20:58.123813 --- ParallelTerminationStrategy: PID 9897 died... 17:20:58.144310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9897): Terminated: ok {rc=0} 17:20:58.191548 --- ParallelTerminationStrategy: PID 9900 died... 17:20:58.211577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9900): Terminated: ok {rc=0} 17:20:58.258185 --- ParallelTerminationStrategy: PID 9903 died... 17:20:58.278212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9903): Terminated: ok {rc=0} 17:20:58.366642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:20:59.570959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:59.578135 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:20:59.598906 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:20:59.626527 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:20:59.678438 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:20:59.699215 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:20:59.726284 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:21:00.275423 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:21:00.327263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.338470 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:21:00.394427 tst mo_mt_call.py: using LAC 35093 17:21:00.517092 tst mo_mt_call.py: using RAC 158 17:21:00.640443 tst mo_mt_call.py: using CellId 35093 17:21:00.771371 tst mo_mt_call.py: using BVCI 35094 17:21:00.899203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.911447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.926597 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.938841 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.951233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:00.963594 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:01.091670 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:01.218797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:01.754180 run create_hlr_db(pid=9909): Launched 17:21:01.943285 bus /sierra_2: Setting Powered False 17:21:03.009101 run create_hlr_db(pid=9909): Terminated: ok {rc=0} 17:21:03.471983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9911): Launched 17:21:03.788605 run osmo-hlr_10.42.42.2(pid=9913): Launched 17:21:03.908022 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:04.448595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9915): Launched 17:21:04.762177 run osmo-stp_10.42.42.5(pid=9916): Launched 17:21:04.880560 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:05.446167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9918): Launched 17:21:05.761334 run osmo-msc_10.42.42.6(pid=9919): Launched 17:21:05.936917 run osmo-stp_10.42.42.5(pid=9916): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9916)] 17:21:06.068848 run osmo-stp_10.42.42.5(pid=9916): stdout: | (launched: 2022-12-13_17:21:04.702974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:06.200474 run osmo-stp_10.42.42.5(pid=9916): stderr: | [0;m[38;5;43m20221213172104877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172104877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172104878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172104878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172104878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172104879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172104879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:06.330292 run osmo-stp_10.42.42.5(pid=9916): stdout: | (launched: 2022-12-13_17:21:04.702974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:06.453775 run osmo-stp_10.42.42.5(pid=9916): stderr: | [0;m[38;5;43m20221213172104877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172104877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172104878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172104878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172104878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172104879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172104879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:06.602228 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9916): Process ended prematurely: osmo-stp_10.42.42.5(pid=9916) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9916)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:21:06.611127 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:21:06.637954 run osmo-hlr_10.42.42.2(pid=9913): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9913)] 17:21:06.686871 run osmo-hlr_10.42.42.2(pid=9913): stdout: | (launched: 2022-12-13_17:21:03.729184) 17:21:06.736928 run osmo-hlr_10.42.42.2(pid=9913): stderr: | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172103910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172103943 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172103953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:06.807081 run osmo-msc_10.42.42.6(pid=9919): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9919)] 17:21:06.855431 run osmo-msc_10.42.42.6(pid=9919): stdout: | (launched: 2022-12-13_17:21:05.701444) 17:21:06.905734 run osmo-msc_10.42.42.6(pid=9919): stderr: | [0;m[38;5;43m20221213172105977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172105978 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff35407ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172105978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172105978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172105978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172105978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172105981 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172105982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172105982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172105982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:06.956255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9911): Terminating (SIGTERM) 17:21:06.996572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9915): Terminating (SIGTERM) 17:21:07.036942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9918): Terminating (SIGTERM) 17:21:07.077875 --- ParallelTerminationStrategy: PID 9911 died... 17:21:07.097327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9911): Terminated: ok {rc=0} 17:21:07.141902 --- ParallelTerminationStrategy: PID 9915 died... 17:21:07.160792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9915): Terminated: ok {rc=0} 17:21:07.205218 --- ParallelTerminationStrategy: PID 9918 died... 17:21:07.224016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9918): Terminated: ok {rc=0} 17:21:07.311517 bus /sierra_3: Setting Powered False 17:21:08.411577 bus /sierra_3: Setting Powered False 17:21:09.528724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:21:10.678170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:10.689996 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:21:10.746101 tst mo_mt_call_osmux.py: using LAC 35094 17:21:10.868577 tst mo_mt_call_osmux.py: using RAC 159 17:21:10.989642 tst mo_mt_call_osmux.py: using CellId 35094 17:21:11.120939 tst mo_mt_call_osmux.py: using BVCI 35095 17:21:11.242790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:11.254702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:11.266224 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:11.277792 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:11.289578 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:11.301332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:11.419857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:11.543230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:12.063049 run create_hlr_db(pid=9921): Launched 17:21:12.189964 bus /sierra_2: Setting Powered False 17:21:13.256344 run create_hlr_db(pid=9921): Terminated: ok {rc=0} 17:21:13.705076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Launched 17:21:14.020757 run osmo-hlr_10.42.42.2(pid=9924): Launched 17:21:14.140129 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:14.678222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Launched 17:21:14.992556 run osmo-stp_10.42.42.5(pid=9927): Launched 17:21:15.112002 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:15.677968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9929): Launched 17:21:16.010120 run osmo-msc_10.42.42.6(pid=9930): Launched 17:21:16.647805 run osmo-stp_10.42.42.5(pid=9927): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] 17:21:16.959815 run osmo-stp_10.42.42.5(pid=9927): stdout: | (launched: 2022-12-13_17:21:14.933301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:17.119403 run osmo-stp_10.42.42.5(pid=9927): stderr: | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172115107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:17.256505 run osmo-stp_10.42.42.5(pid=9927): stdout: | (launched: 2022-12-13_17:21:14.933301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:17.386700 run osmo-stp_10.42.42.5(pid=9927): stderr: | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172115107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172115107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172115108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:17.534889 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9927): Process ended prematurely: osmo-stp_10.42.42.5(pid=9927) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:21:17.543667 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 17:21:17.570287 run osmo-hlr_10.42.42.2(pid=9924): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9924)] 17:21:17.618786 run osmo-hlr_10.42.42.2(pid=9924): stdout: | (launched: 2022-12-13_17:21:13.961433) 17:21:17.668506 run osmo-hlr_10.42.42.2(pid=9924): stderr: | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172114142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172114159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172114169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172114169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172114169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:17.737950 run osmo-msc_10.42.42.6(pid=9930): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9930)] 17:21:17.786211 run osmo-msc_10.42.42.6(pid=9930): stdout: | (launched: 2022-12-13_17:21:15.947676) 17:21:17.835997 run osmo-msc_10.42.42.6(pid=9930): stderr: | [0;m[38;5;43m20221213172116448 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172116448 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99ad5f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172116448 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172116449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172116449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172116450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172116454 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172116455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172116456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172116456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:17.885902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Terminating (SIGTERM) 17:21:17.925538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Terminating (SIGTERM) 17:21:17.965200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9929): Terminating (SIGTERM) 17:21:18.005138 --- ParallelTerminationStrategy: PID 9923 died... 17:21:18.024274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Terminated: ok {rc=0} 17:21:18.068233 --- ParallelTerminationStrategy: PID 9926 died... 17:21:18.086882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Terminated: ok {rc=0} 17:21:18.130764 --- ParallelTerminationStrategy: PID 9929 died... 17:21:18.149520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9929): Terminated: ok {rc=0} 17:21:18.233670 bus /sierra_3: Setting Powered False 17:21:19.333360 bus /sierra_3: Setting Powered False 17:21:20.451058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:21:21.687796 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:21.695290 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:21:21.715810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:21:21.743332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:21:21.796226 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:21:21.818004 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:21:21.844437 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:21:22.394881 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:21:22.449263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:22.461006 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:22.518136 tst mo_mt_call.py: using LAC 35095 17:21:22.650007 tst mo_mt_call.py: using RAC 160 17:21:22.782138 tst mo_mt_call.py: using CellId 35095 17:21:22.914759 tst mo_mt_call.py: using BVCI 35096 17:21:23.038355 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:23.050027 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:23.061409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:23.072592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:23.084243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:23.095942 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:23.214699 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:23.336398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:23.857321 run create_hlr_db(pid=9935): Launched 17:21:23.985050 bus /sierra_2: Setting Powered False 17:21:25.050508 run create_hlr_db(pid=9935): Terminated: ok {rc=0} 17:21:25.499940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9937): Launched 17:21:25.815269 run osmo-hlr_10.42.42.2(pid=9938): Launched 17:21:25.934761 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:26.473452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9940): Launched 17:21:26.788711 run osmo-stp_10.42.42.5(pid=9941): Launched 17:21:26.907780 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:27.472534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9943): Launched 17:21:27.786931 run osmo-msc_10.42.42.6(pid=9944): Launched 17:21:27.962395 run osmo-stp_10.42.42.5(pid=9941): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9941)] 17:21:28.093834 run osmo-stp_10.42.42.5(pid=9941): stdout: | (launched: 2022-12-13_17:21:26.728915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:28.224751 run osmo-stp_10.42.42.5(pid=9941): stderr: | [0;m[38;5;43m20221213172126902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172126902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172126903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172126903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:28.353852 run osmo-stp_10.42.42.5(pid=9941): stdout: | (launched: 2022-12-13_17:21:26.728915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:28.476930 run osmo-stp_10.42.42.5(pid=9941): stderr: | [0;m[38;5;43m20221213172126902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172126902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172126903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172126903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172126904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:28.624509 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9941): Process ended prematurely: osmo-stp_10.42.42.5(pid=9941) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9941)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:21:28.633327 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:21:28.659771 run osmo-hlr_10.42.42.2(pid=9938): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9938)] 17:21:28.708266 run osmo-hlr_10.42.42.2(pid=9938): stdout: | (launched: 2022-12-13_17:21:25.755970) 17:21:28.757956 run osmo-hlr_10.42.42.2(pid=9938): stderr: | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172125936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172125949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172125957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172125958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172125958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:28.827629 run osmo-msc_10.42.42.6(pid=9944): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9944)] 17:21:28.875852 run osmo-msc_10.42.42.6(pid=9944): stdout: | (launched: 2022-12-13_17:21:27.727249) 17:21:28.925661 run osmo-msc_10.42.42.6(pid=9944): stderr: | [0;m[38;5;43m20221213172128003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172128003 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7b953ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172128003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172128003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172128003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172128003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172128005 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172128006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172128006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172128006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:28.975818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9937): Terminating (SIGTERM) 17:21:29.015758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9940): Terminating (SIGTERM) 17:21:29.055799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9943): Terminating (SIGTERM) 17:21:29.096065 --- ParallelTerminationStrategy: PID 9937 died... 17:21:29.115462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9937): Terminated: ok {rc=0} 17:21:29.159644 --- ParallelTerminationStrategy: PID 9940 died... 17:21:29.178433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9940): Terminated: ok {rc=0} 17:21:29.222496 --- ParallelTerminationStrategy: PID 9943 died... 17:21:29.241211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9943): Terminated: ok {rc=0} 17:21:29.325582 bus /sierra_3: Setting Powered False 17:21:30.424476 bus /sierra_3: Setting Powered False 17:21:31.554518 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:21:32.725273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:32.737586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:32.799935 tst mo_mt_call_osmux.py: using LAC 35096 17:21:32.930581 tst mo_mt_call_osmux.py: using RAC 161 17:21:33.059395 tst mo_mt_call_osmux.py: using CellId 35096 17:21:33.188116 tst mo_mt_call_osmux.py: using BVCI 35097 17:21:33.309630 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:33.321411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:33.332780 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:33.344317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:33.356180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:33.367881 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:33.488565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:33.615863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:34.135843 run create_hlr_db(pid=9946): Launched 17:21:34.263411 bus /sierra_2: Setting Powered False 17:21:35.329390 run create_hlr_db(pid=9946): Terminated: ok {rc=0} 17:21:35.777884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Launched 17:21:36.092370 run osmo-hlr_10.42.42.2(pid=9949): Launched 17:21:36.211554 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:36.750426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Launched 17:21:37.064357 run osmo-stp_10.42.42.5(pid=9952): Launched 17:21:37.183786 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:37.749449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Launched 17:21:38.065218 run osmo-msc_10.42.42.6(pid=9955): Launched 17:21:38.240238 run osmo-stp_10.42.42.5(pid=9952): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] 17:21:38.372884 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-13_17:21:37.004646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:38.505325 run osmo-stp_10.42.42.5(pid=9952): stderr: | [0;m[38;5;43m20221213172137180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172137181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172137181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172137181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:38.635351 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-13_17:21:37.004646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:38.759557 run osmo-stp_10.42.42.5(pid=9952): stderr: | [0;m[38;5;43m20221213172137180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172137181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172137181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172137181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172137182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:38.908324 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:21:38.917379 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:21:38.944272 run osmo-hlr_10.42.42.2(pid=9949): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9949)] 17:21:38.992617 run osmo-hlr_10.42.42.2(pid=9949): stdout: | (launched: 2022-12-13_17:21:36.032869) 17:21:39.042801 run osmo-hlr_10.42.42.2(pid=9949): stderr: | [0;m[1;31m20221213172136213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172136214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172136214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172136214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172136214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172136214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172136227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172136238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172136238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172136238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:39.112721 run osmo-msc_10.42.42.6(pid=9955): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9955)] 17:21:39.161068 run osmo-msc_10.42.42.6(pid=9955): stdout: | (launched: 2022-12-13_17:21:38.005576) 17:21:39.211139 run osmo-msc_10.42.42.6(pid=9955): stderr: | [0;m[38;5;43m20221213172138283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172138283 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8868a9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172138283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172138283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172138283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172138283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172138285 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172138285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172138286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172138286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:39.261812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminating (SIGTERM) 17:21:39.301686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminating (SIGTERM) 17:21:39.341827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminating (SIGTERM) 17:21:39.382116 --- ParallelTerminationStrategy: PID 9948 died... 17:21:39.401248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminated: ok {rc=0} 17:21:39.445596 --- ParallelTerminationStrategy: PID 9951 died... 17:21:39.464426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminated: ok {rc=0} 17:21:39.508519 --- ParallelTerminationStrategy: PID 9954 died... 17:21:39.527477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminated: ok {rc=0} 17:21:39.613506 bus /sierra_3: Setting Powered False 17:21:40.713960 bus /sierra_3: Setting Powered False 17:21:41.829431 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:21:43.063203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:43.069804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:21:43.090197 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:21:43.116629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:21:43.168734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:21:43.190478 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:21:43.218705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:21:43.764559 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:21:43.814723 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:43.825926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:43.881584 tst mo_mt_call.py: using LAC 35097 17:21:44.004770 tst mo_mt_call.py: using RAC 162 17:21:44.127225 tst mo_mt_call.py: using CellId 35097 17:21:44.251497 tst mo_mt_call.py: using BVCI 35098 17:21:44.366294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:44.377334 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:44.387959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:44.398690 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:44.409526 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:44.420242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:44.544499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:44.664784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:45.150665 run create_hlr_db(pid=9960): Launched 17:21:45.278438 bus /sierra_2: Setting Powered False 17:21:46.344115 run create_hlr_db(pid=9960): Terminated: ok {rc=0} 17:21:46.795668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Launched 17:21:47.171316 run osmo-hlr_10.42.42.2(pid=9963): Launched 17:21:47.303547 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:47.844891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Launched 17:21:48.160669 run osmo-stp_10.42.42.5(pid=9966): Launched 17:21:48.279106 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:48.843051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Launched 17:21:49.156810 run osmo-msc_10.42.42.6(pid=9969): Launched 17:21:49.331414 run osmo-stp_10.42.42.5(pid=9966): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] 17:21:49.462700 run osmo-stp_10.42.42.5(pid=9966): stdout: | (launched: 2022-12-13_17:21:48.101086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:49.594324 run osmo-stp_10.42.42.5(pid=9966): stderr: | [0;m[38;5;43m20221213172148273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172148274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172148274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172148274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:49.723774 run osmo-stp_10.42.42.5(pid=9966): stdout: | (launched: 2022-12-13_17:21:48.101086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:49.847865 run osmo-stp_10.42.42.5(pid=9966): stderr: | [0;m[38;5;43m20221213172148273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172148274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172148274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172148274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172148275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:49.995886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9966): Process ended prematurely: osmo-stp_10.42.42.5(pid=9966) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:21:50.004825 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:21:50.031654 run osmo-hlr_10.42.42.2(pid=9963): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9963)] 17:21:50.080027 run osmo-hlr_10.42.42.2(pid=9963): stdout: | (launched: 2022-12-13_17:21:47.107596) 17:21:50.129998 run osmo-hlr_10.42.42.2(pid=9963): stderr: | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172147340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172147352 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172147361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172147361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172147361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:50.200104 run osmo-msc_10.42.42.6(pid=9969): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9969)] 17:21:50.248254 run osmo-msc_10.42.42.6(pid=9969): stdout: | (launched: 2022-12-13_17:21:49.097600) 17:21:50.298310 run osmo-msc_10.42.42.6(pid=9969): stderr: | [0;m[38;5;43m20221213172149374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172149374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7544035c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172149374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172149374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172149374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172149375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172149376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172149377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172149377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172149377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:50.348734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Terminating (SIGTERM) 17:21:50.388822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Terminating (SIGTERM) 17:21:50.429048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Terminating (SIGTERM) 17:21:50.469352 --- ParallelTerminationStrategy: PID 9962 died... 17:21:50.488371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Terminated: ok {rc=0} 17:21:50.532687 --- ParallelTerminationStrategy: PID 9965 died... 17:21:50.551477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Terminated: ok {rc=0} 17:21:50.595659 --- ParallelTerminationStrategy: PID 9968 died... 17:21:50.614394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Terminated: ok {rc=0} 17:21:50.700680 bus /sierra_3: Setting Powered False 17:21:51.799566 bus /sierra_3: Setting Powered False 17:21:52.917427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:21:54.067294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.079379 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:54.136016 tst mo_mt_call_osmux.py: using LAC 35098 17:21:54.259586 tst mo_mt_call_osmux.py: using RAC 163 17:21:54.383215 tst mo_mt_call_osmux.py: using CellId 35098 17:21:54.506508 tst mo_mt_call_osmux.py: using BVCI 35099 17:21:54.621119 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.632294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.643203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.654079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.665083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:54.675972 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:54.794300 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:54.917482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:55.438148 run create_hlr_db(pid=9971): Launched 17:21:55.567302 bus /sierra_2: Setting Powered False 17:21:56.632734 run create_hlr_db(pid=9971): Terminated: ok {rc=0} 17:21:57.082635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9973): Launched 17:21:57.398629 run osmo-hlr_10.42.42.2(pid=9974): Launched 17:21:57.517939 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:58.075320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9976): Launched 17:21:58.389776 run osmo-stp_10.42.42.5(pid=9977): Launched 17:21:58.508772 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:59.079579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9979): Launched 17:21:59.397699 run osmo-msc_10.42.42.6(pid=9980): Launched 17:21:59.587306 run osmo-stp_10.42.42.5(pid=9977): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9977)] 17:21:59.730319 run osmo-stp_10.42.42.5(pid=9977): stdout: | (launched: 2022-12-13_17:21:58.330361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:59.875925 run osmo-stp_10.42.42.5(pid=9977): stderr: | [0;m[38;5;43m20221213172158505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172158505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172158506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172158506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172158506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172158507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172158507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:00.016218 run osmo-stp_10.42.42.5(pid=9977): stdout: | (launched: 2022-12-13_17:21:58.330361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:00.149965 run osmo-stp_10.42.42.5(pid=9977): stderr: | [0;m[38;5;43m20221213172158505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172158505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172158506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172158506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172158506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172158507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172158507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:00.309911 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9977): Process ended prematurely: osmo-stp_10.42.42.5(pid=9977) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9977)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:22:00.319675 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:22:00.348430 run osmo-hlr_10.42.42.2(pid=9974): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9974)] 17:22:00.400702 run osmo-hlr_10.42.42.2(pid=9974): stdout: | (launched: 2022-12-13_17:21:57.338896) 17:22:00.454151 run osmo-hlr_10.42.42.2(pid=9974): stderr: | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172157521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172157534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172157543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172157544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172157544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:00.528212 run osmo-msc_10.42.42.6(pid=9980): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9980)] 17:22:00.578913 run osmo-msc_10.42.42.6(pid=9980): stdout: | (launched: 2022-12-13_17:21:59.334295) 17:22:00.631898 run osmo-msc_10.42.42.6(pid=9980): stderr: | [0;m[38;5;43m20221213172159658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172159658 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d8a656c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172159658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172159658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172159658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172159659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172159660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172159661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172159661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172159661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:00.685512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9973): Terminating (SIGTERM) 17:22:00.728363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9976): Terminating (SIGTERM) 17:22:00.771700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9979): Terminating (SIGTERM) 17:22:00.815493 --- ParallelTerminationStrategy: PID 9973 died... 17:22:00.844147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9973): Terminated: ok {rc=0} 17:22:00.893638 --- ParallelTerminationStrategy: PID 9976 died... 17:22:00.922087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9976): Terminated: ok {rc=0} 17:22:00.971580 --- ParallelTerminationStrategy: PID 9979 died... 17:22:00.991398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9979): Terminated: ok {rc=0} 17:22:01.077805 bus /sierra_3: Setting Powered False 17:22:02.176401 bus /sierra_3: Setting Powered False 17:22:03.291914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:22:04.522240 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:04.528505 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:22:04.549135 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:22:04.575819 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:22:04.627367 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:22:04.647970 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:22:04.674305 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:22:05.225081 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:22:05.275207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.286473 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:05.342459 tst mo_mt_call.py: using LAC 35099 17:22:05.467184 tst mo_mt_call.py: using RAC 164 17:22:05.592262 tst mo_mt_call.py: using CellId 35099 17:22:05.716789 tst mo_mt_call.py: using BVCI 35100 17:22:05.831946 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.843027 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.853842 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.864547 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.875292 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:05.886586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:06.003804 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:06.124703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:06.610199 run create_hlr_db(pid=9985): Launched 17:22:06.737589 bus /sierra_2: Setting Powered False 17:22:07.799736 run create_hlr_db(pid=9985): Terminated: ok {rc=0} 17:22:08.258045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9987): Launched 17:22:08.594394 run osmo-hlr_10.42.42.2(pid=9988): Launched 17:22:08.722178 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:09.302811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9990): Launched 17:22:09.638695 run osmo-stp_10.42.42.5(pid=9991): Launched 17:22:09.766996 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:10.372503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9993): Launched 17:22:10.709169 run osmo-msc_10.42.42.6(pid=9994): Launched 17:22:10.895493 run osmo-stp_10.42.42.5(pid=9991): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9991)] 17:22:11.036349 run osmo-stp_10.42.42.5(pid=9991): stdout: | (launched: 2022-12-13_17:22:09.575690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:11.177845 run osmo-stp_10.42.42.5(pid=9991): stderr: | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172209772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:11.317167 run osmo-stp_10.42.42.5(pid=9991): stdout: | (launched: 2022-12-13_17:22:09.575690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:11.450029 run osmo-stp_10.42.42.5(pid=9991): stderr: | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172209771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172209772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172209772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:11.609362 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9991): Process ended prematurely: osmo-stp_10.42.42.5(pid=9991) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9991)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:22:11.618905 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:22:11.647010 run osmo-hlr_10.42.42.2(pid=9988): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9988)] 17:22:11.698813 run osmo-hlr_10.42.42.2(pid=9988): stdout: | (launched: 2022-12-13_17:22:08.531559) 17:22:11.751980 run osmo-hlr_10.42.42.2(pid=9988): stderr: | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172208735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172208752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172208761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172208761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172208761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:11.825775 run osmo-msc_10.42.42.6(pid=9994): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9994)] 17:22:11.876556 run osmo-msc_10.42.42.6(pid=9994): stdout: | (launched: 2022-12-13_17:22:10.646280) 17:22:11.929528 run osmo-msc_10.42.42.6(pid=9994): stderr: | [0;m[38;5;43m20221213172210972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172210972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd674ddac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172210972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172210972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172210973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172210973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172210975 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172210975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172210975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172210975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:11.983248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9987): Terminating (SIGTERM) 17:22:12.025540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9990): Terminating (SIGTERM) 17:22:12.068160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9993): Terminating (SIGTERM) 17:22:12.111420 --- ParallelTerminationStrategy: PID 9987 died... 17:22:12.131969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9987): Terminated: ok {rc=0} 17:22:12.179002 --- ParallelTerminationStrategy: PID 9990 died... 17:22:12.198905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9990): Terminated: ok {rc=0} 17:22:12.246158 --- ParallelTerminationStrategy: PID 9993 died... 17:22:12.266244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9993): Terminated: ok {rc=0} 17:22:12.354862 bus /sierra_3: Setting Powered False 17:22:13.454579 bus /sierra_3: Setting Powered False 17:22:14.572199 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:22:15.721245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:15.732815 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:15.789389 tst mo_mt_call_osmux.py: using LAC 35100 17:22:15.923537 tst mo_mt_call_osmux.py: using RAC 165 17:22:16.050224 tst mo_mt_call_osmux.py: using CellId 35100 17:22:16.185121 tst mo_mt_call_osmux.py: using BVCI 35101 17:22:16.303320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:16.315245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:16.327105 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:16.338975 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:16.351126 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:16.364100 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:16.493933 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:16.621723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:17.162160 run create_hlr_db(pid=9996): Launched 17:22:17.303720 bus /sierra_2: Setting Powered False 17:22:18.369322 run create_hlr_db(pid=9996): Terminated: ok {rc=0} 17:22:18.836892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9998): Launched 17:22:19.173032 run osmo-hlr_10.42.42.2(pid=9999): Launched 17:22:19.300375 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:19.879314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10001): Launched 17:22:20.214568 run osmo-stp_10.42.42.5(pid=10002): Launched 17:22:20.341670 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:20.949258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10004): Launched 17:22:21.284589 run osmo-msc_10.42.42.6(pid=10005): Launched 17:22:21.471056 run osmo-stp_10.42.42.5(pid=10002): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10002)] 17:22:21.611497 run osmo-stp_10.42.42.5(pid=10002): stdout: | (launched: 2022-12-13_17:22:20.151613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:21.752432 run osmo-stp_10.42.42.5(pid=10002): stderr: | [0;m[38;5;43m20221213172220350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172220350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172220351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172220351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172220351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172220351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172220352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:21.892626 run osmo-stp_10.42.42.5(pid=10002): stdout: | (launched: 2022-12-13_17:22:20.151613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:22.025548 run osmo-stp_10.42.42.5(pid=10002): stderr: | [0;m[38;5;43m20221213172220350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172220350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172220351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172220351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172220351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172220351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172220352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:22.184443 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10002): Process ended prematurely: osmo-stp_10.42.42.5(pid=10002) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10002)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:22:22.194108 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:22:22.222082 run osmo-hlr_10.42.42.2(pid=9999): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9999)] 17:22:22.273171 run osmo-hlr_10.42.42.2(pid=9999): stdout: | (launched: 2022-12-13_17:22:19.110550) 17:22:22.326255 run osmo-hlr_10.42.42.2(pid=9999): stderr: | [0;m[1;31m20221213172219311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172219312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172219312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172219312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172219312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172219312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172219324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172219333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172219333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172219333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:22.399602 run osmo-msc_10.42.42.6(pid=10005): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10005)] 17:22:22.450066 run osmo-msc_10.42.42.6(pid=10005): stdout: | (launched: 2022-12-13_17:22:21.221854) 17:22:22.502439 run osmo-msc_10.42.42.6(pid=10005): stderr: | [0;m[38;5;43m20221213172221549 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172221550 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b36dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172221550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172221550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172221550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172221550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172221552 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172221552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172221552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172221552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:22.556092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9998): Terminating (SIGTERM) 17:22:22.598552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10001): Terminating (SIGTERM) 17:22:22.641197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10004): Terminating (SIGTERM) 17:22:22.684166 --- ParallelTerminationStrategy: PID 9998 died... 17:22:22.705133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9998): Terminated: ok {rc=0} 17:22:22.752258 --- ParallelTerminationStrategy: PID 10001 died... 17:22:22.772604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10001): Terminated: ok {rc=0} 17:22:22.820124 --- ParallelTerminationStrategy: PID 10004 died... 17:22:22.840566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10004): Terminated: ok {rc=0} 17:22:22.929282 bus /sierra_3: Setting Powered False 17:22:24.030661 bus /sierra_3: Setting Powered False 17:22:25.149575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:22:26.388930 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:26.396191 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:22:26.417685 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:22:26.446448 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:22:26.500118 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:22:26.521802 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:22:26.550164 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:22:27.099282 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:22:27.154552 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.166094 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:27.229408 tst mo_mt_call.py: using LAC 35101 17:22:27.361089 tst mo_mt_call.py: using RAC 166 17:22:27.484862 tst mo_mt_call.py: using CellId 35101 17:22:27.615857 tst mo_mt_call.py: using BVCI 35102 17:22:27.737566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.749171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.760504 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.771795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.783470 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:27.795430 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:27.915942 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:28.033108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:28.519395 run create_hlr_db(pid=10010): Launched 17:22:28.647697 bus /sierra_2: Setting Powered False 17:22:29.709795 run create_hlr_db(pid=10010): Terminated: ok {rc=0} 17:22:30.168627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10012): Launched 17:22:30.506258 run osmo-hlr_10.42.42.2(pid=10013): Launched 17:22:30.634323 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:31.229836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10015): Launched 17:22:31.584356 run osmo-stp_10.42.42.5(pid=10016): Launched 17:22:31.815625 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:32.514213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10018): Launched 17:22:32.854059 run osmo-msc_10.42.42.6(pid=10019): Launched 17:22:33.043370 run osmo-stp_10.42.42.5(pid=10016): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10016)] 17:22:33.184215 run osmo-stp_10.42.42.5(pid=10016): stdout: | (launched: 2022-12-13_17:22:31.519822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:33.326094 run osmo-stp_10.42.42.5(pid=10016): stderr: | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172231826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:33.465962 run osmo-stp_10.42.42.5(pid=10016): stdout: | (launched: 2022-12-13_17:22:31.519822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:33.599355 run osmo-stp_10.42.42.5(pid=10016): stderr: | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172231825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172231826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172231828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:33.759425 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10016): Process ended prematurely: osmo-stp_10.42.42.5(pid=10016) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10016)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:22:33.769200 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:22:33.797835 run osmo-hlr_10.42.42.2(pid=10013): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10013)] 17:22:33.849918 run osmo-hlr_10.42.42.2(pid=10013): stdout: | (launched: 2022-12-13_17:22:30.443410) 17:22:33.902850 run osmo-hlr_10.42.42.2(pid=10013): stderr: | [0;m[1;31m20221213172230645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172230645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172230645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172230646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172230646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172230646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172230658 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:33.976447 run osmo-msc_10.42.42.6(pid=10019): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10019)] 17:22:34.027026 run osmo-msc_10.42.42.6(pid=10019): stdout: | (launched: 2022-12-13_17:22:32.790565) 17:22:34.080163 run osmo-msc_10.42.42.6(pid=10019): stderr: | [0;m[38;5;43m20221213172233118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172233118 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f53018c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172233118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172233118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172233119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172233119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172233121 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172233121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172233121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172233121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:34.133323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10012): Terminating (SIGTERM) 17:22:34.175880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10015): Terminating (SIGTERM) 17:22:34.219153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10018): Terminating (SIGTERM) 17:22:34.262416 --- ParallelTerminationStrategy: PID 10012 died... 17:22:34.283301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10012): Terminated: ok {rc=0} 17:22:34.330766 --- ParallelTerminationStrategy: PID 10015 died... 17:22:34.351285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10015): Terminated: ok {rc=0} 17:22:34.398881 --- ParallelTerminationStrategy: PID 10018 died... 17:22:34.419338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10018): Terminated: ok {rc=0} 17:22:34.509803 bus /sierra_3: Setting Powered False 17:22:35.609146 bus /sierra_3: Setting Powered False 17:22:36.729148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:22:37.883516 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:37.895883 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:37.957323 tst mo_mt_call_osmux.py: using LAC 35102 17:22:38.088610 tst mo_mt_call_osmux.py: using RAC 167 17:22:38.210631 tst mo_mt_call_osmux.py: using CellId 35102 17:22:38.333491 tst mo_mt_call_osmux.py: using BVCI 35103 17:22:38.447286 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:38.458691 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:38.469628 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:38.480606 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:38.491465 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:38.502349 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:38.625794 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:38.745113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:39.231103 run create_hlr_db(pid=10022): Launched 17:22:39.358200 bus /sierra_2: Setting Powered False 17:22:40.420388 run create_hlr_db(pid=10022): Terminated: ok {rc=0} 17:22:40.879705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10024): Launched 17:22:41.215387 run osmo-hlr_10.42.42.2(pid=10025): Launched 17:22:41.342636 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:41.921375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10027): Launched 17:22:42.257483 run osmo-stp_10.42.42.5(pid=10028): Launched 17:22:42.385492 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:42.993125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10030): Launched 17:22:43.329162 run osmo-msc_10.42.42.6(pid=10031): Launched 17:22:43.515111 run osmo-stp_10.42.42.5(pid=10028): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10028)] 17:22:43.655644 run osmo-stp_10.42.42.5(pid=10028): stdout: | (launched: 2022-12-13_17:22:42.194544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:43.796745 run osmo-stp_10.42.42.5(pid=10028): stderr: | [0;m[38;5;43m20221213172242390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172242390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172242391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172242391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172242393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172242394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172242394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:43.936559 run osmo-stp_10.42.42.5(pid=10028): stdout: | (launched: 2022-12-13_17:22:42.194544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:44.068905 run osmo-stp_10.42.42.5(pid=10028): stderr: | [0;m[38;5;43m20221213172242390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172242390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172242391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172242391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172242393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172242394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172242394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:44.227683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10028): Process ended prematurely: osmo-stp_10.42.42.5(pid=10028) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10028)] [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:22:44.237076 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:22:44.265213 run osmo-hlr_10.42.42.2(pid=10025): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10025)] 17:22:44.316672 run osmo-hlr_10.42.42.2(pid=10025): stdout: | (launched: 2022-12-13_17:22:41.152493) 17:22:44.369618 run osmo-hlr_10.42.42.2(pid=10025): stderr: | [0;m[1;31m20221213172241354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172241354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172241354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172241354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172241354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172241355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172241370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172241380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172241380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172241380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:44.443468 run osmo-msc_10.42.42.6(pid=10031): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10031)] 17:22:44.494336 run osmo-msc_10.42.42.6(pid=10031): stdout: | (launched: 2022-12-13_17:22:43.266185) 17:22:44.547494 run osmo-msc_10.42.42.6(pid=10031): stderr: | [0;m[38;5;43m20221213172243594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172243594 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98ef97ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172243594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172243594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172243594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172243594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172243596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172243596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172243597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172243597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:44.600694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10024): Terminating (SIGTERM) 17:22:44.643421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10027): Terminating (SIGTERM) 17:22:44.686662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10030): Terminating (SIGTERM) 17:22:44.729759 --- ParallelTerminationStrategy: PID 10024 died... 17:22:44.750388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10024): Terminated: ok {rc=0} 17:22:44.797908 --- ParallelTerminationStrategy: PID 10027 died... 17:22:44.818093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10027): Terminated: ok {rc=0} 17:22:44.865425 --- ParallelTerminationStrategy: PID 10030 died... 17:22:44.885742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10030): Terminated: ok {rc=0} 17:22:44.974439 bus /sierra_3: Setting Powered False 17:22:46.075053 bus /sierra_3: Setting Powered False 17:22:47.213704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:22:48.464077 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:48.472482 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:22:48.493950 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:22:48.523649 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:22:48.576135 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:22:48.597294 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:22:48.625127 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:22:49.181931 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:22:49.237386 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.249125 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:49.306956 tst mo_mt_call.py: using LAC 35103 17:22:49.437375 tst mo_mt_call.py: using RAC 168 17:22:49.565792 tst mo_mt_call.py: using CellId 35103 17:22:49.694438 tst mo_mt_call.py: using BVCI 35104 17:22:49.816285 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.828164 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.839643 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.851295 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.863151 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:49.875232 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:49.994326 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:50.112227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:50.631032 run create_hlr_db(pid=10037): Launched 17:22:50.757940 bus /sierra_2: Setting Powered False 17:22:51.824281 run create_hlr_db(pid=10037): Terminated: ok {rc=0} 17:22:52.271929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10039): Launched 17:22:52.588580 run osmo-hlr_10.42.42.2(pid=10040): Launched 17:22:52.708338 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:53.253057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10042): Launched 17:22:53.568593 run osmo-stp_10.42.42.5(pid=10043): Launched 17:22:53.688408 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:54.256326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10045): Launched 17:22:54.572134 run osmo-msc_10.42.42.6(pid=10046): Launched 17:22:54.747533 run osmo-stp_10.42.42.5(pid=10043): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10043)] 17:22:54.880780 run osmo-stp_10.42.42.5(pid=10043): stdout: | (launched: 2022-12-13_17:22:53.508758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:55.012405 run osmo-stp_10.42.42.5(pid=10043): stderr: | [0;m[38;5;43m20221213172253681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172253682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172253682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172253682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:55.142413 run osmo-stp_10.42.42.5(pid=10043): stdout: | (launched: 2022-12-13_17:22:53.508758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:55.266117 run osmo-stp_10.42.42.5(pid=10043): stderr: | [0;m[38;5;43m20221213172253681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172253682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172253682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172253682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172253683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:55.414322 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10043): Process ended prematurely: osmo-stp_10.42.42.5(pid=10043) [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10043)] [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:22:55.423002 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:22:55.449618 run osmo-hlr_10.42.42.2(pid=10040): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10040)] 17:22:55.497648 run osmo-hlr_10.42.42.2(pid=10040): stdout: | (launched: 2022-12-13_17:22:52.528812) 17:22:55.547822 run osmo-hlr_10.42.42.2(pid=10040): stderr: | [0;m[1;31m20221213172252709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172252709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172252710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172252710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172252710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172252710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172252722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172252733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172252733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172252733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:55.617781 run osmo-msc_10.42.42.6(pid=10046): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10046)] 17:22:55.666545 run osmo-msc_10.42.42.6(pid=10046): stdout: | (launched: 2022-12-13_17:22:54.512172) 17:22:55.716268 run osmo-msc_10.42.42.6(pid=10046): stderr: | [0;m[38;5;43m20221213172254786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172254786 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e025f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172254787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172254787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172254787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172254787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172254789 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172254789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172254789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172254789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:55.766706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10039): Terminating (SIGTERM) 17:22:55.806981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10042): Terminating (SIGTERM) 17:22:55.847863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10045): Terminating (SIGTERM) 17:22:55.888644 --- ParallelTerminationStrategy: PID 10039 died... 17:22:55.908087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10039): Terminated: ok {rc=0} 17:22:55.952686 --- ParallelTerminationStrategy: PID 10042 died... 17:22:55.971619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10042): Terminated: ok {rc=0} 17:22:56.016181 --- ParallelTerminationStrategy: PID 10045 died... 17:22:56.035227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10045): Terminated: ok {rc=0} 17:22:56.120220 bus /sierra_3: Setting Powered False 17:22:57.219317 bus /sierra_3: Setting Powered False 17:22:58.337196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:22:59.488395 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:59.500872 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:59.560195 tst mo_mt_call_osmux.py: using LAC 35104 17:22:59.692733 tst mo_mt_call_osmux.py: using RAC 169 17:22:59.823915 tst mo_mt_call_osmux.py: using CellId 35104 17:22:59.956630 tst mo_mt_call_osmux.py: using BVCI 35105 17:23:00.080114 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:23:00.092142 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:23:00.103819 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:23:00.115235 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:23:00.127101 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:23:00.138957 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:23:00.259960 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:23:00.385615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:00.942840 run create_hlr_db(pid=10048): Launched 17:23:01.118682 bus /sierra_2: Setting Powered False 17:23:02.185949 run create_hlr_db(pid=10048): Terminated: ok {rc=0} 17:23:02.644880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10050): Launched 17:23:02.983193 run osmo-hlr_10.42.42.2(pid=10051): Launched 17:23:03.110909 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:03.690801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10053): Launched 17:23:04.027097 run osmo-stp_10.42.42.5(pid=10054): Launched 17:23:04.154854 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:04.761426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10056): Launched 17:23:05.100342 run osmo-msc_10.42.42.6(pid=10057): Launched 17:23:05.287077 run osmo-stp_10.42.42.5(pid=10054): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10054)] 17:23:05.427824 run osmo-stp_10.42.42.5(pid=10054): stdout: | (launched: 2022-12-13_17:23:03.964059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:05.569758 run osmo-stp_10.42.42.5(pid=10054): stderr: | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172304161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:05.709751 run osmo-stp_10.42.42.5(pid=10054): stdout: | (launched: 2022-12-13_17:23:03.964059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:05.843422 run osmo-stp_10.42.42.5(pid=10054): stderr: | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172304160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172304161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172304163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:06.002971 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10054): Process ended prematurely: osmo-stp_10.42.42.5(pid=10054) [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10054)] [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:23:06.012605 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:23:06.040922 run osmo-hlr_10.42.42.2(pid=10051): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10051)] 17:23:06.092441 run osmo-hlr_10.42.42.2(pid=10051): stdout: | (launched: 2022-12-13_17:23:02.920197) 17:23:06.145643 run osmo-hlr_10.42.42.2(pid=10051): stderr: | [0;m[1;31m20221213172303123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172303123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172303123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172303123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172303124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172303124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172303136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172303147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172303147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172303147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:06.218996 run osmo-msc_10.42.42.6(pid=10057): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10057)] 17:23:06.269711 run osmo-msc_10.42.42.6(pid=10057): stdout: | (launched: 2022-12-13_17:23:05.036851) 17:23:06.322837 run osmo-msc_10.42.42.6(pid=10057): stderr: | [0;m[38;5;43m20221213172305363 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172305363 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba329c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172305363 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172305363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172305363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172305364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172305365 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172305366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172305366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172305366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:06.376094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10050): Terminating (SIGTERM) 17:23:06.418373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10053): Terminating (SIGTERM) 17:23:06.461104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10056): Terminating (SIGTERM) 17:23:06.503918 --- ParallelTerminationStrategy: PID 10050 died... 17:23:06.524921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10050): Terminated: ok {rc=0} 17:23:06.572401 --- ParallelTerminationStrategy: PID 10053 died... 17:23:06.592585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10053): Terminated: ok {rc=0} 17:23:06.639893 --- ParallelTerminationStrategy: PID 10056 died... 17:23:06.660328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10056): Terminated: ok {rc=0} 17:23:06.750286 bus /sierra_3: Setting Powered False 17:23:07.850552 bus /sierra_3: Setting Powered False 17:23:08.968862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:23:10.203293 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:10.208856 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:23:10.229352 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:23:10.255755 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:23:10.307826 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:23:10.329783 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:23:10.358293 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:23:10.901918 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:23:10.959124 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:10.970678 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:11.029892 tst mo_mt_call.py: using LAC 35105 17:23:11.160840 tst mo_mt_call.py: using RAC 170 17:23:11.292036 tst mo_mt_call.py: using CellId 35105 17:23:11.426182 tst mo_mt_call.py: using BVCI 35106 17:23:11.549871 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:11.561452 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:11.572627 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:11.583789 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:11.595733 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:11.607767 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:11.729879 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:11.853060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:12.372538 run create_hlr_db(pid=10062): Launched 17:23:12.501656 bus /sierra_2: Setting Powered False 17:23:13.567606 run create_hlr_db(pid=10062): Terminated: ok {rc=0} 17:23:14.018211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10064): Launched 17:23:14.333212 run osmo-hlr_10.42.42.2(pid=10065): Launched 17:23:14.453515 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:14.999796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10067): Launched 17:23:15.314989 run osmo-stp_10.42.42.5(pid=10068): Launched 17:23:15.434795 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:16.021654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10070): Launched 17:23:16.370187 run osmo-msc_10.42.42.6(pid=10071): Launched 17:23:16.656932 run osmo-stp_10.42.42.5(pid=10068): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10068)] 17:23:16.836293 run osmo-stp_10.42.42.5(pid=10068): stdout: | (launched: 2022-12-13_17:23:15.255151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:17.038337 run osmo-stp_10.42.42.5(pid=10068): stderr: | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172315430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:17.284121 run osmo-stp_10.42.42.5(pid=10068): stdout: | (launched: 2022-12-13_17:23:15.255151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:17.429362 run osmo-stp_10.42.42.5(pid=10068): stderr: | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172315430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172315430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172315431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:17.589423 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10068): Process ended prematurely: osmo-stp_10.42.42.5(pid=10068) [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10068)] [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:23:17.599657 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:23:17.628352 run osmo-hlr_10.42.42.2(pid=10065): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10065)] 17:23:17.680889 run osmo-hlr_10.42.42.2(pid=10065): stdout: | (launched: 2022-12-13_17:23:14.273621) 17:23:17.734542 run osmo-hlr_10.42.42.2(pid=10065): stderr: | [0;m[1;31m20221213172314453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172314454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172314454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172314454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172314454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172314454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172314466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172314476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172314476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172314476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:17.809264 run osmo-msc_10.42.42.6(pid=10071): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10071)] 17:23:17.860623 run osmo-msc_10.42.42.6(pid=10071): stdout: | (launched: 2022-12-13_17:23:16.302787) 17:23:17.914548 run osmo-msc_10.42.42.6(pid=10071): stderr: | [0;m[38;5;43m20221213172316987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172316987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f309b08ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172316987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172316988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172316988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172316988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172317002 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172317003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172317003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172317003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:17.968648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10064): Terminating (SIGTERM) 17:23:18.011587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10067): Terminating (SIGTERM) 17:23:18.054759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10070): Terminating (SIGTERM) 17:23:18.098249 --- ParallelTerminationStrategy: PID 10064 died... 17:23:18.119393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10064): Terminated: ok {rc=0} 17:23:18.167193 --- ParallelTerminationStrategy: PID 10067 died... 17:23:18.187675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10067): Terminated: ok {rc=0} 17:23:18.235177 --- ParallelTerminationStrategy: PID 10070 died... 17:23:18.255660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10070): Terminated: ok {rc=0} 17:23:18.345808 bus /sierra_3: Setting Powered False 17:23:19.446276 bus /sierra_3: Setting Powered False 17:23:20.563661 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:23:21.716699 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:21.728806 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:21.787983 tst mo_mt_call_osmux.py: using LAC 35106 17:23:21.919132 tst mo_mt_call_osmux.py: using RAC 171 17:23:22.051000 tst mo_mt_call_osmux.py: using CellId 35106 17:23:22.182474 tst mo_mt_call_osmux.py: using BVCI 35107 17:23:22.305928 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:22.317582 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:22.328637 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:22.340284 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:22.351790 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:22.363338 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:22.482938 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:22.604920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:23.124505 run create_hlr_db(pid=10073): Launched 17:23:23.251798 bus /sierra_2: Setting Powered False 17:23:24.318290 run create_hlr_db(pid=10073): Terminated: ok {rc=0} 17:23:24.786391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10075): Launched 17:23:25.124140 run osmo-hlr_10.42.42.2(pid=10076): Launched 17:23:25.252815 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:25.835567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10078): Launched 17:23:26.172819 run osmo-stp_10.42.42.5(pid=10079): Launched 17:23:26.300845 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:26.912317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10081): Launched 17:23:27.250500 run osmo-msc_10.42.42.6(pid=10082): Launched 17:23:27.436617 run osmo-stp_10.42.42.5(pid=10079): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10079)] 17:23:27.576294 run osmo-stp_10.42.42.5(pid=10079): stdout: | (launched: 2022-12-13_17:23:26.109705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:27.717160 run osmo-stp_10.42.42.5(pid=10079): stderr: | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172326304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:27.857089 run osmo-stp_10.42.42.5(pid=10079): stdout: | (launched: 2022-12-13_17:23:26.109705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:27.990084 run osmo-stp_10.42.42.5(pid=10079): stderr: | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172326303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172326304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172326304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:28.149232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10079): Process ended prematurely: osmo-stp_10.42.42.5(pid=10079) [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10079)] [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:23:28.158777 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:23:28.186783 run osmo-hlr_10.42.42.2(pid=10076): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10076)] 17:23:28.238058 run osmo-hlr_10.42.42.2(pid=10076): stdout: | (launched: 2022-12-13_17:23:25.061286) 17:23:28.290637 run osmo-hlr_10.42.42.2(pid=10076): stderr: | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172325261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172325274 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172325282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172325282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172325282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:28.364552 run osmo-msc_10.42.42.6(pid=10082): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10082)] 17:23:28.415135 run osmo-msc_10.42.42.6(pid=10082): stdout: | (launched: 2022-12-13_17:23:27.187236) 17:23:28.468215 run osmo-msc_10.42.42.6(pid=10082): stderr: | [0;m[38;5;43m20221213172327513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172327513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c90789c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172327514 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172327514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172327514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172327514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172327516 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172327516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172327516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172327516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:28.521492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10075): Terminating (SIGTERM) 17:23:28.563638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10078): Terminating (SIGTERM) 17:23:28.606662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10081): Terminating (SIGTERM) 17:23:28.649579 --- ParallelTerminationStrategy: PID 10075 died... 17:23:28.669623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10075): Terminated: ok {rc=0} 17:23:28.716650 --- ParallelTerminationStrategy: PID 10078 died... 17:23:28.736849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10078): Terminated: ok {rc=0} 17:23:28.783621 --- ParallelTerminationStrategy: PID 10081 died... 17:23:28.803806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10081): Terminated: ok {rc=0} 17:23:28.895121 bus /sierra_3: Setting Powered False 17:23:29.991684 bus /sierra_3: Setting Powered False 17:23:31.113528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:oc2g --------------------------------------------------------------------- 17:23:32.367413 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:32.372533 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 17:23:32.393898 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 17:23:32.420594 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 17:23:32.505051 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 17:23:32.525684 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 17:23:32.553143 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 17:23:33.134129 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 17:23:33.139100 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.150173 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:33.185475 tst emergency_mo_mt_call.py: using LAC 35107 17:23:33.315939 tst emergency_mo_mt_call.py: using RAC 172 17:23:33.444371 tst emergency_mo_mt_call.py: using CellId 35107 17:23:33.573320 tst emergency_mo_mt_call.py: using BVCI 35108 17:23:33.694493 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.705834 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.716852 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.727772 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.739210 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:33.750744 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:33.873949 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:33.992080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:34.470238 run create_hlr_db(pid=10087): Launched 17:23:34.595887 bus /sierra_2: Setting Powered False 17:23:35.656662 run create_hlr_db(pid=10087): Terminated: ok {rc=0} 17:23:36.109702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Launched 17:23:36.440508 run osmo-hlr_10.42.42.2(pid=10090): Launched 17:23:36.566535 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:37.137384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10092): Launched 17:23:37.468859 run osmo-stp_10.42.42.5(pid=10093): Launched 17:23:37.604188 tst emergency_mo_mt_call.py: using MSISDN 8247 17:23:37.775107 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:38.369167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10095): Launched 17:23:38.700702 run osmo-msc_10.42.42.6(pid=10096): Launched 17:23:38.884274 run osmo-stp_10.42.42.5(pid=10093): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10093)] 17:23:39.023801 run osmo-stp_10.42.42.5(pid=10093): stdout: | (launched: 2022-12-13_17:23:37.406737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:39.164208 run osmo-stp_10.42.42.5(pid=10093): stderr: | [0;m[38;5;43m20221213172337603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172337603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172337604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172337604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:39.302179 run osmo-stp_10.42.42.5(pid=10093): stdout: | (launched: 2022-12-13_17:23:37.406737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:39.434146 run osmo-stp_10.42.42.5(pid=10093): stderr: | [0;m[38;5;43m20221213172337603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172337603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172337604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172337604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172337605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:39.591247 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10093): Process ended prematurely: osmo-stp_10.42.42.5(pid=10093) [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10093)] [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py:19] 17:23:39.600239 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 17:23:39.628090 run osmo-hlr_10.42.42.2(pid=10090): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10090)] 17:23:39.679690 run osmo-hlr_10.42.42.2(pid=10090): stdout: | (launched: 2022-12-13_17:23:36.378350) 17:23:39.732739 run osmo-hlr_10.42.42.2(pid=10090): stderr: | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172336579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172336592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172336602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172336602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172336603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:39.807393 run osmo-msc_10.42.42.6(pid=10096): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10096)] 17:23:39.858980 run osmo-msc_10.42.42.6(pid=10096): stdout: | (launched: 2022-12-13_17:23:38.637856) 17:23:39.912153 run osmo-msc_10.42.42.6(pid=10096): stderr: | [0;m[38;5;43m20221213172338962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172338963 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f51d1362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172338963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172338963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172338963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172338963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172338965 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172338965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172338966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172338966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:39.965861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Terminating (SIGTERM) 17:23:40.008362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10092): Terminating (SIGTERM) 17:23:40.051398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10095): Terminating (SIGTERM) 17:23:40.094684 --- ParallelTerminationStrategy: PID 10089 died... 17:23:40.115716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Terminated: ok {rc=0} 17:23:40.163162 --- ParallelTerminationStrategy: PID 10092 died... 17:23:40.183378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10092): Terminated: ok {rc=0} 17:23:40.230487 --- ParallelTerminationStrategy: PID 10095 died... 17:23:40.250775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10095): Terminated: ok {rc=0} 17:23:40.339715 bus /sierra_3: Setting Powered False 17:23:41.440297 bus /sierra_3: Setting Powered False 17:23:42.561785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 17:23:43.652133 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:43.664122 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:43.702852 tst emergency_preemptive_call.py: using LAC 35108 17:23:43.824622 tst emergency_preemptive_call.py: using RAC 173 17:23:43.946297 tst emergency_preemptive_call.py: using CellId 35108 17:23:44.066330 tst emergency_preemptive_call.py: using BVCI 35109 17:23:44.187253 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:44.198609 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:44.209617 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:44.220634 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:44.232752 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:44.244605 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:44.365662 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:44.488691 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:44.606924 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:44.727490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:45.243004 run create_hlr_db(pid=10098): Launched 17:23:45.368720 bus /sierra_2: Setting Powered False 17:23:46.432346 run create_hlr_db(pid=10098): Terminated: ok {rc=0} 17:23:46.901911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10100): Launched 17:23:47.268566 run osmo-hlr_10.42.42.2(pid=10111): Launched 17:23:47.503300 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:48.177231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Launched 17:23:48.508255 run osmo-stp_10.42.42.5(pid=10115): Launched 17:23:48.776117 tst emergency_preemptive_call.py: using MSISDN 8248 17:23:49.009683 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:49.568040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10117): Launched 17:23:49.910278 run osmo-msc_10.42.42.6(pid=10118): Launched 17:23:50.244003 run osmo-stp_10.42.42.5(pid=10115): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] 17:23:50.572697 run osmo-stp_10.42.42.5(pid=10115): stdout: | (launched: 2022-12-13_17:23:48.444614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:50.841141 run osmo-stp_10.42.42.5(pid=10115): stderr: | [0;m[38;5;43m20221213172348738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172348738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172348739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172348739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172348739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172348740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172348740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:51.020195 run osmo-stp_10.42.42.5(pid=10115): stdout: | (launched: 2022-12-13_17:23:48.444614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:51.166269 run osmo-stp_10.42.42.5(pid=10115): stderr: | [0;m[38;5;43m20221213172348738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172348738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172348739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172348739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172348739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172348740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172348740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:51.334883 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10115): Process ended prematurely: osmo-stp_10.42.42.5(pid=10115) [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py:32] 17:23:51.344098 tst emergency_preemptive_call.py:32: Test FAILED (7.7 sec) 17:23:51.378892 run osmo-hlr_10.42.42.2(pid=10111): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10111)] 17:23:51.442348 run osmo-hlr_10.42.42.2(pid=10111): stdout: | (launched: 2022-12-13_17:23:47.204876) 17:23:51.504926 run osmo-hlr_10.42.42.2(pid=10111): stderr: | [0;m[1;31m20221213172347522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172347522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172347522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172347522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172347523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172347533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172347555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172347563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172347563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172347563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:51.593455 run osmo-msc_10.42.42.6(pid=10118): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10118)] 17:23:51.651883 run osmo-msc_10.42.42.6(pid=10118): stdout: | (launched: 2022-12-13_17:23:49.840673) 17:23:51.714912 run osmo-msc_10.42.42.6(pid=10118): stderr: | [0;m[38;5;43m20221213172350370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172350370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bfcac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172350370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172350371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172350371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172350371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172350373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172350373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172350373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172350373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:51.781486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10100): Terminating (SIGTERM) 17:23:51.833070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Terminating (SIGTERM) 17:23:51.890766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10117): Terminating (SIGTERM) 17:23:51.946064 --- ParallelTerminationStrategy: PID 10100 died... 17:23:51.973939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10100): Terminated: ok {rc=0} 17:23:52.027906 --- ParallelTerminationStrategy: PID 10114 died... 17:23:52.055408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Terminated: ok {rc=0} 17:23:52.114175 --- ParallelTerminationStrategy: PID 10117 died... 17:23:52.138079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10117): Terminated: ok {rc=0} 17:23:52.247855 bus /sierra_9: Setting Powered False 17:23:53.364794 bus /sierra_9: Setting Powered False 17:23:54.481337 bus /sierra_8: Setting Powered False 17:23:55.582896 bus /sierra_8: Setting Powered False 17:23:56.700320 bus /sierra_3: Setting Powered False 17:23:57.802093 bus /sierra_3: Setting Powered False 17:23:58.921444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:oc2g --------------------------------------------------------------------- 17:24:00.185541 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:00.190671 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 17:24:00.212742 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 17:24:00.252637 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 17:24:00.339813 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 17:24:00.362868 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 17:24:00.402342 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 17:24:01.044557 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 17:24:01.105024 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.117025 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:01.160046 tst cs_paging_gprs_active.py: using LAC 35109 17:24:01.343601 tst cs_paging_gprs_active.py: using RAC 174 17:24:01.510716 tst cs_paging_gprs_active.py: using CellId 35109 17:24:01.647633 tst cs_paging_gprs_active.py: using BVCI 35110 17:24:01.817324 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.829472 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.841803 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.856888 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.871717 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.887013 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.901222 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.917858 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:01.933072 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:02.081756 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:02.241672 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:24:02.502448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:02.856168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10383): Launched 17:24:03.171968 run iperf3-srv_10.42.42.10(pid=10384): Launched 17:24:03.312549 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:24:03.542891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:03.887998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10385): Launched 17:24:04.198303 run iperf3-srv_10.42.42.10(pid=10386): Launched 17:24:04.339621 tst cs_paging_gprs_active.py:38: start network... 17:24:04.570844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:05.100115 run create_hlr_db(pid=10387): Launched 17:24:05.269083 bus /sierra_2: Setting Powered False 17:24:06.336596 run create_hlr_db(pid=10387): Terminated: ok {rc=0} 17:24:06.817575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Launched 17:24:07.177631 run osmo-hlr_10.42.42.2(pid=10390): Launched 17:24:07.434378 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:08.128374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Launched 17:24:08.486943 run osmo-stp_10.42.42.5(pid=10393): Launched 17:24:08.747388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:09.421360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Launched 17:24:09.566330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:09.862643 run patchelf(pid=10396): Launched 17:24:10.068502 run osmo-stp_10.42.42.5(pid=10393): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] 17:24:10.218561 run osmo-stp_10.42.42.5(pid=10393): stdout: | (launched: 2022-12-13_17:24:08.423741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:10.370023 run osmo-stp_10.42.42.5(pid=10393): stderr: | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172408730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:10.519959 run osmo-stp_10.42.42.5(pid=10393): stdout: | (launched: 2022-12-13_17:24:08.423741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:10.667559 run osmo-stp_10.42.42.5(pid=10393): stderr: | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172408730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172408730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172408731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:10.830822 run patchelf(pid=10396): Terminating (SIGINT) 17:24:11.021978 run patchelf(pid=10396): Terminated: ok {rc=0} 17:24:11.159796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10393): Process ended prematurely: osmo-stp_10.42.42.5(pid=10393) [trial-2392↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] [trial-2392↪gprs:oc2g↪cs_paging_gprs_active.py:38] 17:24:11.170396 tst cs_paging_gprs_active.py:38: Test FAILED (10.1 sec) 17:24:11.199915 run osmo-hlr_10.42.42.2(pid=10390): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10390)] 17:24:11.252614 run osmo-hlr_10.42.42.2(pid=10390): stdout: | (launched: 2022-12-13_17:24:07.110520) 17:24:11.306096 run osmo-hlr_10.42.42.2(pid=10390): stderr: | [0;m[1;31m20221213172407420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172407420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172407420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172407420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172407420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172407421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172407441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172407458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172407458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172407458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:11.359710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10383): Terminating (SIGTERM) 17:24:11.402849 run iperf3-srv_10.42.42.10(pid=10384): Terminating (SIGTERM) 17:24:11.446456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10385): Terminating (SIGTERM) 17:24:11.489664 run iperf3-srv_10.42.42.10(pid=10386): Terminating (SIGTERM) 17:24:11.532868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Terminating (SIGTERM) 17:24:11.576066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Terminating (SIGTERM) 17:24:11.619336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Terminating (SIGTERM) 17:24:11.663503 --- ParallelTerminationStrategy: PID 10383 died... 17:24:11.684212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10383): Terminated: ok {rc=0} 17:24:11.732492 --- ParallelTerminationStrategy: PID 10384 died... 17:24:11.753137 run iperf3-srv_10.42.42.10(pid=10384): Terminated {rc=256} 17:24:11.800702 --- ParallelTerminationStrategy: PID 10385 died... 17:24:11.821242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10385): Terminated: ok {rc=0} 17:24:11.869056 --- ParallelTerminationStrategy: PID 10386 died... 17:24:11.889581 run iperf3-srv_10.42.42.10(pid=10386): Terminated {rc=256} 17:24:11.937106 --- ParallelTerminationStrategy: PID 10389 died... 17:24:11.957687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Terminated: ok {rc=0} 17:24:12.005332 --- ParallelTerminationStrategy: PID 10392 died... 17:24:12.025928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Terminated: ok {rc=0} 17:24:12.073575 --- ParallelTerminationStrategy: PID 10395 died... 17:24:12.094085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Terminated: ok {rc=0} 17:24:12.183253 bus /gobi_0: Setting Powered False 17:24:13.282932 bus /gobi_0: Setting Powered False 17:24:14.403098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g iperf3.py ---------------------------------------------- 17:24:15.554467 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:15.567353 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:15.607651 tst iperf3.py: using LAC 35110 17:24:15.730280 tst iperf3.py: using RAC 175 17:24:15.870604 tst iperf3.py: using CellId 35110 17:24:16.006173 tst iperf3.py: using BVCI 35111 17:24:16.120901 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.131759 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.143247 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.154853 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.166389 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.177984 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.189262 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.200333 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:16.215011 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:16.356009 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:16.591430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:17.005798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10397): Launched 17:24:17.293717 run iperf3-srv_10.42.42.10(pid=10398): Launched 17:24:17.416098 tst iperf3.py:8: start network... 17:24:17.625204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:18.110972 run create_hlr_db(pid=10399): Launched 17:24:18.239231 bus /gobi_6: Setting Powered False 17:24:19.301103 run create_hlr_db(pid=10399): Terminated: ok {rc=0} 17:24:19.760020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10401): Launched 17:24:20.114817 run osmo-hlr_10.42.42.2(pid=10402): Launched 17:24:20.242562 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:20.817845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10404): Launched 17:24:21.158447 run osmo-stp_10.42.42.5(pid=10405): Launched 17:24:21.284905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:21.863246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10407): Launched 17:24:21.992503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:22.275356 run patchelf(pid=10408): Launched 17:24:22.461356 run osmo-stp_10.42.42.5(pid=10405): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10405)] 17:24:22.603177 run osmo-stp_10.42.42.5(pid=10405): stdout: | (launched: 2022-12-13_17:24:21.097106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:22.746224 run osmo-stp_10.42.42.5(pid=10405): stderr: | [0;m[38;5;43m20221213172421287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172421287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172421288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172421288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:22.890078 run osmo-stp_10.42.42.5(pid=10405): stdout: | (launched: 2022-12-13_17:24:21.097106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:23.026892 run osmo-stp_10.42.42.5(pid=10405): stderr: | [0;m[38;5;43m20221213172421287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172421287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172421288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172421288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172421289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:23.188536 run patchelf(pid=10408): Terminating (SIGINT) 17:24:23.378650 run patchelf(pid=10408): Terminated: ok {rc=0} 17:24:23.514820 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10405): Process ended prematurely: osmo-stp_10.42.42.5(pid=10405) [trial-2392↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10405)] [trial-2392↪gprs:oc2g↪iperf3.py:8] 17:24:23.525124 tst iperf3.py:8: Test FAILED (8.0 sec) 17:24:23.553947 run osmo-hlr_10.42.42.2(pid=10402): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10402)] 17:24:23.605200 run osmo-hlr_10.42.42.2(pid=10402): stdout: | (launched: 2022-12-13_17:24:20.048303) 17:24:23.658029 run osmo-hlr_10.42.42.2(pid=10402): stderr: | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172420249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172420262 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172420271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172420271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172420271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:23.711544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10397): Terminating (SIGTERM) 17:24:23.754129 run iperf3-srv_10.42.42.10(pid=10398): Terminating (SIGTERM) 17:24:23.797446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10401): Terminating (SIGTERM) 17:24:23.840730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10404): Terminating (SIGTERM) 17:24:23.883776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10407): Terminating (SIGTERM) 17:24:23.927042 --- ParallelTerminationStrategy: PID 10397 died... 17:24:23.948015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10397): Terminated: ok {rc=0} 17:24:23.995431 --- ParallelTerminationStrategy: PID 10398 died... 17:24:24.015797 run iperf3-srv_10.42.42.10(pid=10398): Terminated {rc=256} 17:24:24.063005 --- ParallelTerminationStrategy: PID 10401 died... 17:24:24.083468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10401): Terminated: ok {rc=0} 17:24:24.130596 --- ParallelTerminationStrategy: PID 10404 died... 17:24:24.151015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10404): Terminated: ok {rc=0} 17:24:24.198250 --- ParallelTerminationStrategy: PID 10407 died... 17:24:24.218466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10407): Terminated: ok {rc=0} 17:24:24.307377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g iperf3m4.py ---------------------------------------------- 17:24:25.459590 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:25.471596 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:25.508099 tst iperf3m4.py: using LAC 35111 17:24:25.640533 tst iperf3m4.py: using RAC 176 17:24:25.771353 tst iperf3m4.py: using CellId 35111 17:24:25.908576 tst iperf3m4.py: using BVCI 35112 17:24:26.021976 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.032451 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.042908 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.053298 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.063589 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.073967 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.084265 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.094641 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:26.105469 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:26.223712 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:26.348300 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:26.467253 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:26.588686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:26.797155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:27.110664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Launched 17:24:27.385746 run iperf3-srv_10.42.42.10(pid=10410): Launched 17:24:27.503954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:24:27.713281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:28.026903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10411): Launched 17:24:28.299365 run iperf3-srv_10.42.42.10(pid=10412): Launched 17:24:28.416896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:24:28.624550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:28.936487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10413): Launched 17:24:29.210138 run iperf3-srv_10.42.42.10(pid=10414): Launched 17:24:29.328417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:24:29.535390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:29.847541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10415): Launched 17:24:30.119959 run iperf3-srv_10.42.42.10(pid=10416): Launched 17:24:30.251919 tst iperf3m4.py:8: start network... 17:24:30.457257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:30.949808 run create_hlr_db(pid=10417): Launched 17:24:31.127873 bus /gobi_6: Setting Powered False 17:24:32.208437 run create_hlr_db(pid=10417): Terminated: ok {rc=0} 17:24:32.647164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10419): Launched 17:24:32.955429 run osmo-hlr_10.42.42.2(pid=10420): Launched 17:24:33.072560 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:33.602379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10422): Launched 17:24:33.913041 run osmo-stp_10.42.42.5(pid=10423): Launched 17:24:34.030644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:34.567955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10425): Launched 17:24:34.687488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:34.950753 run patchelf(pid=10426): Launched 17:24:35.125651 run osmo-stp_10.42.42.5(pid=10423): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10423)] 17:24:35.257650 run osmo-stp_10.42.42.5(pid=10423): stdout: | (launched: 2022-12-13_17:24:33.855738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:35.391468 run osmo-stp_10.42.42.5(pid=10423): stderr: | [0;m[38;5;43m20221213172434025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172434025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172434026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172434026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:35.524787 run osmo-stp_10.42.42.5(pid=10423): stdout: | (launched: 2022-12-13_17:24:33.855738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:35.651786 run osmo-stp_10.42.42.5(pid=10423): stderr: | [0;m[38;5;43m20221213172434025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172434025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172434026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172434026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172434027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:35.802705 run patchelf(pid=10426): Terminating (SIGINT) 17:24:35.979847 run patchelf(pid=10426): Terminated: ok {rc=0} 17:24:36.107456 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10423): Process ended prematurely: osmo-stp_10.42.42.5(pid=10423) [trial-2392↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10423)] [trial-2392↪gprs:oc2g↪iperf3m4.py:8] 17:24:36.116888 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:24:36.144738 run osmo-hlr_10.42.42.2(pid=10420): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10420)] 17:24:36.193301 run osmo-hlr_10.42.42.2(pid=10420): stdout: | (launched: 2022-12-13_17:24:32.898898) 17:24:36.243526 run osmo-hlr_10.42.42.2(pid=10420): stderr: | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172433074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172433086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172433095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172433095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172433095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:36.294183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Terminating (SIGTERM) 17:24:36.334763 run iperf3-srv_10.42.42.10(pid=10410): Terminating (SIGTERM) 17:24:36.375123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10411): Terminating (SIGTERM) 17:24:36.415420 run iperf3-srv_10.42.42.10(pid=10412): Terminating (SIGTERM) 17:24:36.455639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10413): Terminating (SIGTERM) 17:24:36.495977 run iperf3-srv_10.42.42.10(pid=10414): Terminating (SIGTERM) 17:24:36.536025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10415): Terminating (SIGTERM) 17:24:36.576208 run iperf3-srv_10.42.42.10(pid=10416): Terminating (SIGTERM) 17:24:36.616241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10419): Terminating (SIGTERM) 17:24:36.656311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10422): Terminating (SIGTERM) 17:24:36.696649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10425): Terminating (SIGTERM) 17:24:36.737304 --- ParallelTerminationStrategy: PID 10409 died... 17:24:36.756635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Terminated: ok {rc=0} 17:24:36.801304 --- ParallelTerminationStrategy: PID 10410 died... 17:24:36.820059 run iperf3-srv_10.42.42.10(pid=10410): Terminated {rc=256} 17:24:36.864658 --- ParallelTerminationStrategy: PID 10411 died... 17:24:36.883683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10411): Terminated: ok {rc=0} 17:24:36.928133 --- ParallelTerminationStrategy: PID 10412 died... 17:24:36.947075 run iperf3-srv_10.42.42.10(pid=10412): Terminated {rc=256} 17:24:36.991459 --- ParallelTerminationStrategy: PID 10413 died... 17:24:37.010496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10413): Terminated: ok {rc=0} 17:24:37.055098 --- ParallelTerminationStrategy: PID 10414 died... 17:24:37.074119 run iperf3-srv_10.42.42.10(pid=10414): Terminated {rc=256} 17:24:37.118732 --- ParallelTerminationStrategy: PID 10415 died... 17:24:37.137728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10415): Terminated: ok {rc=0} 17:24:37.182909 --- ParallelTerminationStrategy: PID 10416 died... 17:24:37.201938 run iperf3-srv_10.42.42.10(pid=10416): Terminated {rc=256} 17:24:37.246455 --- ParallelTerminationStrategy: PID 10419 died... 17:24:37.265636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10419): Terminated: ok {rc=0} 17:24:37.310119 --- ParallelTerminationStrategy: PID 10422 died... 17:24:37.329142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10422): Terminated: ok {rc=0} 17:24:37.374094 --- ParallelTerminationStrategy: PID 10425 died... 17:24:37.393243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10425): Terminated: ok {rc=0} 17:24:37.477401 bus /gobi_4: Setting Powered False 17:24:38.575191 bus /gobi_4: Setting Powered False 17:24:39.689690 bus /gobi_1: Setting Powered False 17:24:40.788614 bus /gobi_1: Setting Powered False 17:24:41.906909 bus /gobi_0: Setting Powered False 17:24:43.006787 bus /gobi_0: Setting Powered False 17:24:44.130335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g ping.py ---------------------------------------------- 17:24:45.233956 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.245231 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:45.281436 tst ping.py: using LAC 35112 17:24:45.411297 tst ping.py: using RAC 177 17:24:45.541804 tst ping.py: using CellId 35112 17:24:45.670764 tst ping.py: using BVCI 35113 17:24:45.792049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.803331 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.814315 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.826186 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.842586 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.856093 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.868610 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:45.881712 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:46.029100 tst ping.py:19: start network... 17:24:46.292587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:46.847123 run create_hlr_db(pid=10427): Launched 17:24:47.023257 bus /gobi_6: Setting Powered False 17:24:48.083705 run create_hlr_db(pid=10427): Terminated: ok {rc=0} 17:24:48.580589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Launched 17:24:48.909472 run osmo-hlr_10.42.42.2(pid=10430): Launched 17:24:49.035391 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:49.606644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Launched 17:24:49.936007 run osmo-stp_10.42.42.5(pid=10433): Launched 17:24:50.063065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:50.630375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10435): Launched 17:24:50.756186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:51.035345 run patchelf(pid=10436): Launched 17:24:51.219755 run osmo-stp_10.42.42.5(pid=10433): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] 17:24:51.359579 run osmo-stp_10.42.42.5(pid=10433): stdout: | (launched: 2022-12-13_17:24:49.875546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:51.501552 run osmo-stp_10.42.42.5(pid=10433): stderr: | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172450065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172450065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172450066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172450066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:51.643143 run osmo-stp_10.42.42.5(pid=10433): stdout: | (launched: 2022-12-13_17:24:49.875546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:51.778317 run osmo-stp_10.42.42.5(pid=10433): stderr: | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172450064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172450065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172450065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172450066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172450066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:51.938784 run patchelf(pid=10436): Terminating (SIGINT) 17:24:52.125217 run patchelf(pid=10436): Terminated: ok {rc=0} 17:24:52.259608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10433): Process ended prematurely: osmo-stp_10.42.42.5(pid=10433) [trial-2392↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] [trial-2392↪gprs:oc2g↪ping.py:22] 17:24:52.269405 tst ping.py:22: Test FAILED (7.0 sec) 17:24:52.298287 run osmo-hlr_10.42.42.2(pid=10430): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10430)] 17:24:52.350701 run osmo-hlr_10.42.42.2(pid=10430): stdout: | (launched: 2022-12-13_17:24:48.848591) 17:24:52.404693 run osmo-hlr_10.42.42.2(pid=10430): stderr: | [0;m[1;31m20221213172449043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172449043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172449044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172449044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172449044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172449044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172449056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172449064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172449064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172449064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:52.458823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Terminating (SIGTERM) 17:24:52.501953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Terminating (SIGTERM) 17:24:52.545384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10435): Terminating (SIGTERM) 17:24:52.589118 --- ParallelTerminationStrategy: PID 10429 died... 17:24:52.610185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Terminated: ok {rc=0} 17:24:52.658116 --- ParallelTerminationStrategy: PID 10432 died... 17:24:52.678706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Terminated: ok {rc=0} 17:24:52.726461 --- ParallelTerminationStrategy: PID 10435 died... 17:24:52.747098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10435): Terminated: ok {rc=0} 17:24:52.837266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 17:24:53.925443 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:53.937218 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:53.973739 tst ping_idle_ping.py: using LAC 35113 17:24:54.103569 tst ping_idle_ping.py: using RAC 178 17:24:54.229441 tst ping_idle_ping.py: using CellId 35113 17:24:54.349931 tst ping_idle_ping.py: using BVCI 35114 17:24:54.462961 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.473824 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.484407 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.494932 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.505389 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.516134 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.527309 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:54.538225 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:54.661327 tst ping_idle_ping.py:24: start network... 17:24:54.867823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:55.344271 run create_hlr_db(pid=10438): Launched 17:24:55.470631 bus /gobi_6: Setting Powered False 17:24:56.535908 run create_hlr_db(pid=10438): Terminated: ok {rc=0} 17:24:56.995604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10440): Launched 17:24:57.325576 run osmo-hlr_10.42.42.2(pid=10441): Launched 17:24:57.452399 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:58.026389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10443): Launched 17:24:58.357679 run osmo-stp_10.42.42.5(pid=10444): Launched 17:24:58.484220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:59.054172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10446): Launched 17:24:59.182158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:59.461168 run patchelf(pid=10447): Launched 17:24:59.644900 run osmo-stp_10.42.42.5(pid=10444): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10444)] 17:24:59.784488 run osmo-stp_10.42.42.5(pid=10444): stdout: | (launched: 2022-12-13_17:24:58.297140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:59.927038 run osmo-stp_10.42.42.5(pid=10444): stderr: | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172458488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172458488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172458488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172458489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:00.068809 run osmo-stp_10.42.42.5(pid=10444): stdout: | (launched: 2022-12-13_17:24:58.297140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:00.203972 run osmo-stp_10.42.42.5(pid=10444): stderr: | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172458487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172458488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172458488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172458488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172458489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:00.364718 run patchelf(pid=10447): Terminating (SIGINT) 17:25:00.551245 run patchelf(pid=10447): Terminated: ok {rc=0} 17:25:00.685383 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10444): Process ended prematurely: osmo-stp_10.42.42.5(pid=10444) [trial-2392↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10444)] [trial-2392↪gprs:oc2g↪ping_idle_ping.py:27] 17:25:00.695129 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:25:00.723909 run osmo-hlr_10.42.42.2(pid=10441): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10441)] 17:25:00.775801 run osmo-hlr_10.42.42.2(pid=10441): stdout: | (launched: 2022-12-13_17:24:57.264532) 17:25:00.834271 run osmo-hlr_10.42.42.2(pid=10441): stderr: | [0;m[1;31m20221213172457459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172457459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172457459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172457459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172457460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172457460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172457472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172457481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172457481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172457481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:00.890896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10440): Terminating (SIGTERM) 17:25:00.936082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10443): Terminating (SIGTERM) 17:25:00.981638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10446): Terminating (SIGTERM) 17:25:01.044789 --- ParallelTerminationStrategy: PID 10440 died... 17:25:01.066116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10440): Terminated: ok {rc=0} 17:25:01.115955 --- ParallelTerminationStrategy: PID 10443 died... 17:25:01.137800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10443): Terminated: ok {rc=0} 17:25:01.187415 --- ParallelTerminationStrategy: PID 10446 died... 17:25:01.209532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10446): Terminated: ok {rc=0} 17:25:01.302942 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 17:25:02.603377 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:02.609582 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:25:02.631267 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:25:02.672026 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:25:02.763264 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:25:02.784530 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:25:02.823734 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:25:03.415180 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:25:03.469478 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:03.480469 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:03.517373 tst cs_paging_gprs_active.py: using LAC 35114 17:25:03.651420 tst cs_paging_gprs_active.py: using RAC 179 17:25:03.779762 tst cs_paging_gprs_active.py: using CellId 35114 17:25:03.907665 tst cs_paging_gprs_active.py: using BVCI 35115 17:25:04.029362 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.040450 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.051513 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.062591 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.074313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.086048 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.097899 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.109619 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:04.121504 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:04.243727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:04.363519 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:25:04.570225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:04.879490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10455): Launched 17:25:05.147162 run iperf3-srv_10.42.42.10(pid=10456): Launched 17:25:05.262557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:25:05.468782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:05.778024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10457): Launched 17:25:06.046291 run iperf3-srv_10.42.42.10(pid=10458): Launched 17:25:06.163144 tst cs_paging_gprs_active.py:38: start network... 17:25:06.368651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:06.846121 run create_hlr_db(pid=10459): Launched 17:25:06.974038 bus /gobi_6: Setting Powered False 17:25:08.035166 run create_hlr_db(pid=10459): Terminated: ok {rc=0} 17:25:08.484647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10461): Launched 17:25:08.814837 run osmo-hlr_10.42.42.2(pid=10462): Launched 17:25:08.942260 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:09.510973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10464): Launched 17:25:09.822958 run osmo-stp_10.42.42.5(pid=10465): Launched 17:25:09.939023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:10.484275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10467): Launched 17:25:10.602911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:10.862581 run patchelf(pid=10468): Launched 17:25:11.035194 run osmo-stp_10.42.42.5(pid=10465): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10465)] 17:25:11.165922 run osmo-stp_10.42.42.5(pid=10465): stdout: | (launched: 2022-12-13_17:25:09.766747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:11.297828 run osmo-stp_10.42.42.5(pid=10465): stderr: | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172509937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:11.429953 run osmo-stp_10.42.42.5(pid=10465): stdout: | (launched: 2022-12-13_17:25:09.766747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:11.555897 run osmo-stp_10.42.42.5(pid=10465): stderr: | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172509936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172509937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172509937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:11.705939 run patchelf(pid=10468): Terminating (SIGINT) 17:25:11.880401 run patchelf(pid=10468): Terminated: ok {rc=0} 17:25:12.006439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10465): Process ended prematurely: osmo-stp_10.42.42.5(pid=10465) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10465)] [trial-2392↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:25:12.015894 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:25:12.043209 run osmo-hlr_10.42.42.2(pid=10462): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10462)] 17:25:12.091817 run osmo-hlr_10.42.42.2(pid=10462): stdout: | (launched: 2022-12-13_17:25:08.755053) 17:25:12.142088 run osmo-hlr_10.42.42.2(pid=10462): stderr: | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172508949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172508962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172508970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172508971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172508971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:12.192803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10455): Terminating (SIGTERM) 17:25:12.233518 run iperf3-srv_10.42.42.10(pid=10456): Terminating (SIGTERM) 17:25:12.274037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10457): Terminating (SIGTERM) 17:25:12.314644 run iperf3-srv_10.42.42.10(pid=10458): Terminating (SIGTERM) 17:25:12.355268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10461): Terminating (SIGTERM) 17:25:12.395907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10464): Terminating (SIGTERM) 17:25:12.436433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10467): Terminating (SIGTERM) 17:25:12.477372 --- ParallelTerminationStrategy: PID 10455 died... 17:25:12.496757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10455): Terminated: ok {rc=0} 17:25:12.542003 --- ParallelTerminationStrategy: PID 10456 died... 17:25:12.560841 run iperf3-srv_10.42.42.10(pid=10456): Terminated {rc=256} 17:25:12.605393 --- ParallelTerminationStrategy: PID 10457 died... 17:25:12.624236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10457): Terminated: ok {rc=0} 17:25:12.668592 --- ParallelTerminationStrategy: PID 10458 died... 17:25:12.687442 run iperf3-srv_10.42.42.10(pid=10458): Terminated {rc=256} 17:25:12.731813 --- ParallelTerminationStrategy: PID 10461 died... 17:25:12.750710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10461): Terminated: ok {rc=0} 17:25:12.795425 --- ParallelTerminationStrategy: PID 10464 died... 17:25:12.814431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10464): Terminated: ok {rc=0} 17:25:12.858930 --- ParallelTerminationStrategy: PID 10467 died... 17:25:12.877757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10467): Terminated: ok {rc=0} 17:25:12.964729 bus /gobi_0: Setting Powered False 17:25:14.067723 bus /gobi_0: Setting Powered False 17:25:15.184863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:25:16.341546 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.354670 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:16.394521 tst iperf3.py: using LAC 35115 17:25:16.529150 tst iperf3.py: using RAC 180 17:25:16.685025 tst iperf3.py: using CellId 35115 17:25:16.818804 tst iperf3.py: using BVCI 35116 17:25:16.933973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.945039 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.955913 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.966788 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.977892 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.988600 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:16.999689 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:17.011037 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:17.022460 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:17.147097 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:17.353421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:17.661421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Launched 17:25:17.931326 run iperf3-srv_10.42.42.10(pid=10470): Launched 17:25:18.046181 tst iperf3.py:8: start network... 17:25:18.251353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:18.724909 run create_hlr_db(pid=10471): Launched 17:25:18.850094 bus /gobi_6: Setting Powered False 17:25:19.911297 run create_hlr_db(pid=10471): Terminated: ok {rc=0} 17:25:20.359048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10473): Launched 17:25:20.687224 run osmo-hlr_10.42.42.2(pid=10474): Launched 17:25:20.812700 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:21.383855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Launched 17:25:21.712643 run osmo-stp_10.42.42.5(pid=10477): Launched 17:25:21.838782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:22.403920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Launched 17:25:22.530379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:22.807941 run patchelf(pid=10480): Launched 17:25:22.991636 run osmo-stp_10.42.42.5(pid=10477): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] 17:25:23.131796 run osmo-stp_10.42.42.5(pid=10477): stdout: | (launched: 2022-12-13_17:25:21.652836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:23.273221 run osmo-stp_10.42.42.5(pid=10477): stderr: | [0;m[38;5;43m20221213172521842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172521842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172521843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172521843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:23.414258 run osmo-stp_10.42.42.5(pid=10477): stdout: | (launched: 2022-12-13_17:25:21.652836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:23.549186 run osmo-stp_10.42.42.5(pid=10477): stderr: | [0;m[38;5;43m20221213172521842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172521842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172521843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172521843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172521844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:23.708735 run patchelf(pid=10480): Terminating (SIGINT) 17:25:23.895528 run patchelf(pid=10480): Terminated: ok {rc=0} 17:25:24.030124 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10477): Process ended prematurely: osmo-stp_10.42.42.5(pid=10477) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 17:25:24.040403 tst iperf3.py:8: Test FAILED (7.7 sec) 17:25:24.069069 run osmo-hlr_10.42.42.2(pid=10474): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10474)] 17:25:24.120458 run osmo-hlr_10.42.42.2(pid=10474): stdout: | (launched: 2022-12-13_17:25:20.627771) 17:25:24.173592 run osmo-hlr_10.42.42.2(pid=10474): stderr: | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172520823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172520835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172520844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172520844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172520844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:24.226506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Terminating (SIGTERM) 17:25:24.269069 run iperf3-srv_10.42.42.10(pid=10470): Terminating (SIGTERM) 17:25:24.312101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10473): Terminating (SIGTERM) 17:25:24.355011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Terminating (SIGTERM) 17:25:24.397688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Terminating (SIGTERM) 17:25:24.440562 --- ParallelTerminationStrategy: PID 10469 died... 17:25:24.461338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Terminated: ok {rc=0} 17:25:24.508811 --- ParallelTerminationStrategy: PID 10470 died... 17:25:24.529137 run iperf3-srv_10.42.42.10(pid=10470): Terminated {rc=256} 17:25:24.576221 --- ParallelTerminationStrategy: PID 10473 died... 17:25:24.596335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10473): Terminated: ok {rc=0} 17:25:24.643512 --- ParallelTerminationStrategy: PID 10476 died... 17:25:24.663803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Terminated: ok {rc=0} 17:25:24.711211 --- ParallelTerminationStrategy: PID 10479 died... 17:25:24.731560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Terminated: ok {rc=0} 17:25:24.822526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:25:25.976241 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:25.988137 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:26.026684 tst iperf3m4.py: using LAC 35116 17:25:26.149111 tst iperf3m4.py: using RAC 181 17:25:26.272791 tst iperf3m4.py: using CellId 35116 17:25:26.395004 tst iperf3m4.py: using BVCI 35117 17:25:26.508404 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.519362 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.530134 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.540851 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.551802 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.562933 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.574220 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.585373 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:26.596498 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:26.721190 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:26.841224 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:26.965663 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:27.083360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:27.290079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:27.600607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10481): Launched 17:25:27.869575 run iperf3-srv_10.42.42.10(pid=10482): Launched 17:25:27.985599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:25:28.192004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:28.503248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Launched 17:25:28.770939 run iperf3-srv_10.42.42.10(pid=10484): Launched 17:25:28.886194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:25:29.091356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:29.401030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10485): Launched 17:25:29.670344 run iperf3-srv_10.42.42.10(pid=10486): Launched 17:25:29.786307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:25:29.991769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:30.301620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10487): Launched 17:25:30.571728 run iperf3-srv_10.42.42.10(pid=10488): Launched 17:25:30.686709 tst iperf3m4.py:8: start network... 17:25:30.898151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:31.383121 run create_hlr_db(pid=10489): Launched 17:25:31.542392 bus /gobi_6: Setting Powered False 17:25:32.603427 run create_hlr_db(pid=10489): Terminated: ok {rc=0} 17:25:33.051992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10491): Launched 17:25:33.381356 run osmo-hlr_10.42.42.2(pid=10492): Launched 17:25:33.507016 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:34.074982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10494): Launched 17:25:34.405219 run osmo-stp_10.42.42.5(pid=10495): Launched 17:25:34.531183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:35.100244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10497): Launched 17:25:35.229692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:35.508281 run patchelf(pid=10498): Launched 17:25:35.693210 run osmo-stp_10.42.42.5(pid=10495): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10495)] 17:25:35.833323 run osmo-stp_10.42.42.5(pid=10495): stdout: | (launched: 2022-12-13_17:25:34.344806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:35.975752 run osmo-stp_10.42.42.5(pid=10495): stderr: | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172534534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172534535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:36.117750 run osmo-stp_10.42.42.5(pid=10495): stdout: | (launched: 2022-12-13_17:25:34.344806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:36.252759 run osmo-stp_10.42.42.5(pid=10495): stderr: | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172534533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172534534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172534535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:36.412724 run patchelf(pid=10498): Terminating (SIGINT) 17:25:36.600197 run patchelf(pid=10498): Terminated: ok {rc=0} 17:25:36.735226 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10495): Process ended prematurely: osmo-stp_10.42.42.5(pid=10495) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10495)] [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 17:25:36.745547 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:25:36.774329 run osmo-hlr_10.42.42.2(pid=10492): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10492)] 17:25:36.826249 run osmo-hlr_10.42.42.2(pid=10492): stdout: | (launched: 2022-12-13_17:25:33.321238) 17:25:36.879967 run osmo-hlr_10.42.42.2(pid=10492): stderr: | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172533516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172533531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172533542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172533542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172533542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:36.933745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10481): Terminating (SIGTERM) 17:25:36.976413 run iperf3-srv_10.42.42.10(pid=10482): Terminating (SIGTERM) 17:25:37.019580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Terminating (SIGTERM) 17:25:37.062640 run iperf3-srv_10.42.42.10(pid=10484): Terminating (SIGTERM) 17:25:37.105909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10485): Terminating (SIGTERM) 17:25:37.148910 run iperf3-srv_10.42.42.10(pid=10486): Terminating (SIGTERM) 17:25:37.191840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10487): Terminating (SIGTERM) 17:25:37.236355 run iperf3-srv_10.42.42.10(pid=10488): Terminating (SIGTERM) 17:25:37.276784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10491): Terminating (SIGTERM) 17:25:37.317262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10494): Terminating (SIGTERM) 17:25:37.358096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10497): Terminating (SIGTERM) 17:25:37.398960 --- ParallelTerminationStrategy: PID 10481 died... 17:25:37.418396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10481): Terminated: ok {rc=0} 17:25:37.463329 --- ParallelTerminationStrategy: PID 10482 died... 17:25:37.482309 run iperf3-srv_10.42.42.10(pid=10482): Terminated {rc=256} 17:25:37.527275 --- ParallelTerminationStrategy: PID 10483 died... 17:25:37.546333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Terminated: ok {rc=0} 17:25:37.591138 --- ParallelTerminationStrategy: PID 10484 died... 17:25:37.610214 run iperf3-srv_10.42.42.10(pid=10484): Terminated {rc=256} 17:25:37.654644 --- ParallelTerminationStrategy: PID 10485 died... 17:25:37.673539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10485): Terminated: ok {rc=0} 17:25:37.718191 --- ParallelTerminationStrategy: PID 10486 died... 17:25:37.737337 run iperf3-srv_10.42.42.10(pid=10486): Terminated {rc=256} 17:25:37.782094 --- ParallelTerminationStrategy: PID 10487 died... 17:25:37.801187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10487): Terminated: ok {rc=0} 17:25:37.846350 --- ParallelTerminationStrategy: PID 10488 died... 17:25:37.865647 run iperf3-srv_10.42.42.10(pid=10488): Terminated {rc=256} 17:25:37.910555 --- ParallelTerminationStrategy: PID 10491 died... 17:25:37.929637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10491): Terminated: ok {rc=0} 17:25:37.974361 --- ParallelTerminationStrategy: PID 10494 died... 17:25:37.993344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10494): Terminated: ok {rc=0} 17:25:38.038152 --- ParallelTerminationStrategy: PID 10497 died... 17:25:38.057193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10497): Terminated: ok {rc=0} 17:25:38.142223 bus /gobi_4: Setting Powered False 17:25:39.242641 bus /gobi_4: Setting Powered False 17:25:40.360056 bus /gobi_1: Setting Powered False 17:25:41.459556 bus /gobi_1: Setting Powered False 17:25:42.576651 bus /gobi_0: Setting Powered False 17:25:43.675940 bus /gobi_0: Setting Powered False 17:25:44.794106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 17:25:45.904899 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:45.916867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:45.957216 tst ping.py: using LAC 35117 17:25:46.105319 tst ping.py: using RAC 182 17:25:46.223617 tst ping.py: using CellId 35117 17:25:46.353392 tst ping.py: using BVCI 35118 17:25:46.496602 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.509541 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.522166 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.534735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.548063 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.562985 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.579327 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:46.592795 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:46.716294 tst ping.py:19: start network... 17:25:47.000742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:47.510156 run create_hlr_db(pid=10499): Launched 17:25:47.638224 bus /gobi_6: Setting Powered False 17:25:48.702093 run create_hlr_db(pid=10499): Terminated: ok {rc=0} 17:25:49.135784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Launched 17:25:49.437768 run osmo-hlr_10.42.42.2(pid=10502): Launched 17:25:49.551342 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:50.077473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Launched 17:25:50.380553 run osmo-stp_10.42.42.5(pid=10505): Launched 17:25:50.494391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:51.015323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10507): Launched 17:25:51.131361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:51.386638 run patchelf(pid=10508): Launched 17:25:51.554105 run osmo-stp_10.42.42.5(pid=10505): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] 17:25:51.682728 run osmo-stp_10.42.42.5(pid=10505): stdout: | (launched: 2022-12-13_17:25:50.324577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:51.813216 run osmo-stp_10.42.42.5(pid=10505): stderr: | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172550494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:51.944334 run osmo-stp_10.42.42.5(pid=10505): stdout: | (launched: 2022-12-13_17:25:50.324577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:52.069313 run osmo-stp_10.42.42.5(pid=10505): stderr: | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172550493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172550494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172550494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:52.216607 run patchelf(pid=10508): Terminating (SIGINT) 17:25:52.388887 run patchelf(pid=10508): Terminated: ok {rc=0} 17:25:52.512835 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10505): Process ended prematurely: osmo-stp_10.42.42.5(pid=10505) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 17:25:52.521768 tst ping.py:22: Test FAILED (6.6 sec) 17:25:52.549017 run osmo-hlr_10.42.42.2(pid=10502): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10502)] 17:25:52.598000 run osmo-hlr_10.42.42.2(pid=10502): stdout: | (launched: 2022-12-13_17:25:49.382454) 17:25:52.648374 run osmo-hlr_10.42.42.2(pid=10502): stderr: | [0;m[1;31m20221213172549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172549555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172549555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172549555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172549567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172549576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172549577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172549577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:52.699160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Terminating (SIGTERM) 17:25:52.739635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Terminating (SIGTERM) 17:25:52.780239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10507): Terminating (SIGTERM) 17:25:52.821052 --- ParallelTerminationStrategy: PID 10501 died... 17:25:52.840571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Terminated: ok {rc=0} 17:25:52.885510 --- ParallelTerminationStrategy: PID 10504 died... 17:25:52.904584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Terminated: ok {rc=0} 17:25:52.949255 --- ParallelTerminationStrategy: PID 10507 died... 17:25:52.968106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10507): Terminated: ok {rc=0} 17:25:53.053547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:25:54.141867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.154484 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:54.194235 tst ping_idle_ping.py: using LAC 35118 17:25:54.322772 tst ping_idle_ping.py: using RAC 183 17:25:54.452826 tst ping_idle_ping.py: using CellId 35118 17:25:54.579996 tst ping_idle_ping.py: using BVCI 35119 17:25:54.691728 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.702607 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.713367 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.723958 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.734711 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.745406 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.756487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:54.767232 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:54.887353 tst ping_idle_ping.py:24: start network... 17:25:55.106593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:55.610274 run create_hlr_db(pid=10513): Launched 17:25:55.735844 bus /gobi_6: Setting Powered False 17:25:56.800084 run create_hlr_db(pid=10513): Terminated: ok {rc=0} 17:25:57.254795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10515): Launched 17:25:57.580778 run osmo-hlr_10.42.42.2(pid=10516): Launched 17:25:57.706492 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:58.268864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10518): Launched 17:25:58.592814 run osmo-stp_10.42.42.5(pid=10519): Launched 17:25:58.716358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:59.277923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10521): Launched 17:25:59.402145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:59.677218 run patchelf(pid=10522): Launched 17:25:59.847913 run osmo-stp_10.42.42.5(pid=10519): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10519)] 17:25:59.977456 run osmo-stp_10.42.42.5(pid=10519): stdout: | (launched: 2022-12-13_17:25:58.533397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:00.109345 run osmo-stp_10.42.42.5(pid=10519): stderr: | [0;m[38;5;43m20221213172558722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172558722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172558723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172558723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:00.240876 run osmo-stp_10.42.42.5(pid=10519): stdout: | (launched: 2022-12-13_17:25:58.533397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:00.365810 run osmo-stp_10.42.42.5(pid=10519): stderr: | [0;m[38;5;43m20221213172558722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172558722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172558723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172558723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172558724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:00.513891 run patchelf(pid=10522): Terminating (SIGINT) 17:26:00.686706 run patchelf(pid=10522): Terminated: ok {rc=0} 17:26:00.811600 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10519): Process ended prematurely: osmo-stp_10.42.42.5(pid=10519) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10519)] [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 17:26:00.820606 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:26:00.861510 run osmo-hlr_10.42.42.2(pid=10516): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10516)] 17:26:00.919968 run osmo-hlr_10.42.42.2(pid=10516): stdout: | (launched: 2022-12-13_17:25:57.520836) 17:26:00.979611 run osmo-hlr_10.42.42.2(pid=10516): stderr: | [0;m[1;31m20221213172557715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172557715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172557716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172557716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172557716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172557716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172557726 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172557735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172557735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172557735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:01.036661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10515): Terminating (SIGTERM) 17:26:01.081170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10518): Terminating (SIGTERM) 17:26:01.127991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10521): Terminating (SIGTERM) 17:26:01.174661 --- ParallelTerminationStrategy: PID 10515 died... 17:26:01.197165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10515): Terminated: ok {rc=0} 17:26:01.247330 --- ParallelTerminationStrategy: PID 10518 died... 17:26:01.269376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10518): Terminated: ok {rc=0} 17:26:01.319337 --- ParallelTerminationStrategy: PID 10521 died... 17:26:01.341646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10521): Terminated: ok {rc=0} 17:26:01.442957 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:26:02.756345 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:02.763539 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:26:02.785208 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:26:02.826251 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:26:02.916910 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:26:02.939109 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:26:02.979114 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:26:03.570941 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:26:03.624263 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:03.635561 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:03.693435 tst cs_paging_gprs_active.py: using LAC 35119 17:26:03.822554 tst cs_paging_gprs_active.py: using RAC 184 17:26:03.954301 tst cs_paging_gprs_active.py: using CellId 35119 17:26:04.085528 tst cs_paging_gprs_active.py: using BVCI 35120 17:26:04.207560 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.218958 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.230130 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.241252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.252827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.264182 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.275624 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.287050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:04.298706 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:04.419076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:04.541951 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:26:04.765665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:05.096929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10527): Launched 17:26:05.385184 run iperf3-srv_10.42.42.10(pid=10528): Launched 17:26:05.510631 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:26:05.734483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:06.067845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10529): Launched 17:26:06.356667 run iperf3-srv_10.42.42.10(pid=10530): Launched 17:26:06.480035 tst cs_paging_gprs_active.py:38: start network... 17:26:06.703266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:07.215232 run create_hlr_db(pid=10531): Launched 17:26:07.340855 bus /gobi_6: Setting Powered False 17:26:08.406403 run create_hlr_db(pid=10531): Terminated: ok {rc=0} 17:26:08.848934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10533): Launched 17:26:09.158650 run osmo-hlr_10.42.42.2(pid=10534): Launched 17:26:09.275503 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:09.807266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10536): Launched 17:26:10.117928 run osmo-stp_10.42.42.5(pid=10538): Launched 17:26:10.235239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:10.769705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10540): Launched 17:26:10.888296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:11.149919 run patchelf(pid=10541): Launched 17:26:11.322280 run osmo-stp_10.42.42.5(pid=10538): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] 17:26:11.453712 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-13_17:26:10.060343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:11.586820 run osmo-stp_10.42.42.5(pid=10538): stderr: | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172610232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172610233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:11.719410 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-13_17:26:10.060343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:11.845934 run osmo-stp_10.42.42.5(pid=10538): stderr: | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172610231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172610232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172610233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:11.995432 run patchelf(pid=10541): Terminating (SIGINT) 17:26:12.171865 run patchelf(pid=10541): Terminated: ok {rc=0} 17:26:12.298685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:26:12.308124 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:26:12.335297 run osmo-hlr_10.42.42.2(pid=10534): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10534)] 17:26:12.383489 run osmo-hlr_10.42.42.2(pid=10534): stdout: | (launched: 2022-12-13_17:26:09.102257) 17:26:12.433515 run osmo-hlr_10.42.42.2(pid=10534): stderr: | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172609276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172609289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172609297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172609297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172609297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:12.483945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10527): Terminating (SIGTERM) 17:26:12.523985 run iperf3-srv_10.42.42.10(pid=10528): Terminating (SIGTERM) 17:26:12.564078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10529): Terminating (SIGTERM) 17:26:12.604269 run iperf3-srv_10.42.42.10(pid=10530): Terminating (SIGTERM) 17:26:12.644167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10533): Terminating (SIGTERM) 17:26:12.684245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10536): Terminating (SIGTERM) 17:26:12.724073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10540): Terminating (SIGTERM) 17:26:12.764118 --- ParallelTerminationStrategy: PID 10527 died... 17:26:12.783352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10527): Terminated: ok {rc=0} 17:26:12.827579 --- ParallelTerminationStrategy: PID 10528 died... 17:26:12.846210 run iperf3-srv_10.42.42.10(pid=10528): Terminated {rc=256} 17:26:12.889916 --- ParallelTerminationStrategy: PID 10529 died... 17:26:12.908452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10529): Terminated: ok {rc=0} 17:26:12.952435 --- ParallelTerminationStrategy: PID 10530 died... 17:26:12.970996 run iperf3-srv_10.42.42.10(pid=10530): Terminated {rc=256} 17:26:13.014902 --- ParallelTerminationStrategy: PID 10533 died... 17:26:13.033584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10533): Terminated: ok {rc=0} 17:26:13.077611 --- ParallelTerminationStrategy: PID 10536 died... 17:26:13.096316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10536): Terminated: ok {rc=0} 17:26:13.140325 --- ParallelTerminationStrategy: PID 10540 died... 17:26:13.159019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10540): Terminated: ok {rc=0} 17:26:13.245403 bus /gobi_0: Setting Powered False 17:26:14.347355 bus /gobi_0: Setting Powered False 17:26:15.467570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:26:16.652589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:16.668923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:16.745281 tst iperf3.py: using LAC 35120 17:26:16.868012 tst iperf3.py: using RAC 185 17:26:17.002945 tst iperf3.py: using CellId 35120 17:26:17.132514 tst iperf3.py: using BVCI 35121 17:26:17.246720 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.258219 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.268668 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.279298 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.289843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.300269 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.311114 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.322068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:17.333214 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:17.452647 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:17.659729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:17.969345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Launched 17:26:18.238761 run iperf3-srv_10.42.42.10(pid=10543): Launched 17:26:18.354168 tst iperf3.py:8: start network... 17:26:18.560272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:19.036098 run create_hlr_db(pid=10544): Launched 17:26:19.161317 bus /gobi_6: Setting Powered False 17:26:20.223292 run create_hlr_db(pid=10544): Terminated: ok {rc=0} 17:26:20.673230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Launched 17:26:21.002288 run osmo-hlr_10.42.42.2(pid=10547): Launched 17:26:21.127360 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:21.698164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Launched 17:26:22.030608 run osmo-stp_10.42.42.5(pid=10550): Launched 17:26:22.156193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:22.725246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Launched 17:26:22.851870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:23.131300 run patchelf(pid=10553): Launched 17:26:23.316714 run osmo-stp_10.42.42.5(pid=10550): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] 17:26:23.456523 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-13_17:26:21.970250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:23.598293 run osmo-stp_10.42.42.5(pid=10550): stderr: | [0;m[38;5;43m20221213172622160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172622161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172622161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172622161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:23.740537 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-13_17:26:21.970250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:23.875905 run osmo-stp_10.42.42.5(pid=10550): stderr: | [0;m[38;5;43m20221213172622160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172622161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172622161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172622161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172622162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:24.037014 run patchelf(pid=10553): Terminating (SIGINT) 17:26:24.223829 run patchelf(pid=10553): Terminated: ok {rc=0} 17:26:24.358733 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 17:26:24.369503 tst iperf3.py:8: Test FAILED (7.8 sec) 17:26:24.398036 run osmo-hlr_10.42.42.2(pid=10547): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10547)] 17:26:24.449555 run osmo-hlr_10.42.42.2(pid=10547): stdout: | (launched: 2022-12-13_17:26:20.942529) 17:26:24.502576 run osmo-hlr_10.42.42.2(pid=10547): stderr: | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172621137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172621150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172621160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172621160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172621161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:24.556638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminating (SIGTERM) 17:26:24.598986 run iperf3-srv_10.42.42.10(pid=10543): Terminating (SIGTERM) 17:26:24.642140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminating (SIGTERM) 17:26:24.685042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminating (SIGTERM) 17:26:24.728037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminating (SIGTERM) 17:26:24.770862 --- ParallelTerminationStrategy: PID 10542 died... 17:26:24.791539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminated: ok {rc=0} 17:26:24.838895 --- ParallelTerminationStrategy: PID 10543 died... 17:26:24.859096 run iperf3-srv_10.42.42.10(pid=10543): Terminated {rc=256} 17:26:24.906483 --- ParallelTerminationStrategy: PID 10546 died... 17:26:24.926611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminated: ok {rc=0} 17:26:24.973596 --- ParallelTerminationStrategy: PID 10549 died... 17:26:24.993654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminated: ok {rc=0} 17:26:25.040669 --- ParallelTerminationStrategy: PID 10552 died... 17:26:25.060837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminated: ok {rc=0} 17:26:25.150204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:26:26.304145 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.316355 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:26.373455 tst iperf3m4.py: using LAC 35121 17:26:26.494422 tst iperf3m4.py: using RAC 186 17:26:26.616555 tst iperf3m4.py: using CellId 35121 17:26:26.736530 tst iperf3m4.py: using BVCI 35122 17:26:26.849196 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.860019 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.870902 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.881763 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.892217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.906364 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.918121 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.929774 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:26.941367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:27.062384 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:27.188229 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:27.308391 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:27.430878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:27.654065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:27.986027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Launched 17:26:28.274667 run iperf3-srv_10.42.42.10(pid=10555): Launched 17:26:28.400461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:26:28.623278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:28.955566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Launched 17:26:29.245410 run iperf3-srv_10.42.42.10(pid=10557): Launched 17:26:29.369102 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:26:29.591588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:29.924363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10558): Launched 17:26:30.213654 run iperf3-srv_10.42.42.10(pid=10559): Launched 17:26:30.338416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:26:30.562108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:30.906626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10560): Launched 17:26:31.197750 run iperf3-srv_10.42.42.10(pid=10561): Launched 17:26:31.331011 tst iperf3m4.py:8: start network... 17:26:31.558686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:32.083751 run create_hlr_db(pid=10562): Launched 17:26:32.234509 bus /gobi_6: Setting Powered False 17:26:33.295987 run create_hlr_db(pid=10562): Terminated: ok {rc=0} 17:26:33.728641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10564): Launched 17:26:34.038626 run osmo-hlr_10.42.42.2(pid=10565): Launched 17:26:34.155278 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:34.687270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10567): Launched 17:26:34.995985 run osmo-stp_10.42.42.5(pid=10568): Launched 17:26:35.113556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:35.647307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10570): Launched 17:26:35.765989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:36.027797 run patchelf(pid=10571): Launched 17:26:36.200281 run osmo-stp_10.42.42.5(pid=10568): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10568)] 17:26:36.332481 run osmo-stp_10.42.42.5(pid=10568): stdout: | (launched: 2022-12-13_17:26:34.939281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:36.465109 run osmo-stp_10.42.42.5(pid=10568): stderr: | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172635108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:36.597811 run osmo-stp_10.42.42.5(pid=10568): stdout: | (launched: 2022-12-13_17:26:34.939281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:36.724007 run osmo-stp_10.42.42.5(pid=10568): stderr: | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172635108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172635108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172635109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:36.873857 run patchelf(pid=10571): Terminating (SIGINT) 17:26:37.050521 run patchelf(pid=10571): Terminated: ok {rc=0} 17:26:37.177866 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10568): Process ended prematurely: osmo-stp_10.42.42.5(pid=10568) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10568)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:26:37.187297 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:26:37.214908 run osmo-hlr_10.42.42.2(pid=10565): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10565)] 17:26:37.263461 run osmo-hlr_10.42.42.2(pid=10565): stdout: | (launched: 2022-12-13_17:26:33.981500) 17:26:37.314126 run osmo-hlr_10.42.42.2(pid=10565): stderr: | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172634155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172634172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172634183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172634183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172634183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:37.365257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Terminating (SIGTERM) 17:26:37.405644 run iperf3-srv_10.42.42.10(pid=10555): Terminating (SIGTERM) 17:26:37.445890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Terminating (SIGTERM) 17:26:37.486319 run iperf3-srv_10.42.42.10(pid=10557): Terminating (SIGTERM) 17:26:37.526375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10558): Terminating (SIGTERM) 17:26:37.566688 run iperf3-srv_10.42.42.10(pid=10559): Terminating (SIGTERM) 17:26:37.606727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10560): Terminating (SIGTERM) 17:26:37.646845 run iperf3-srv_10.42.42.10(pid=10561): Terminating (SIGTERM) 17:26:37.686868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10564): Terminating (SIGTERM) 17:26:37.727131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10567): Terminating (SIGTERM) 17:26:37.767183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10570): Terminating (SIGTERM) 17:26:37.807554 --- ParallelTerminationStrategy: PID 10554 died... 17:26:37.826945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Terminated: ok {rc=0} 17:26:37.871559 --- ParallelTerminationStrategy: PID 10555 died... 17:26:37.890398 run iperf3-srv_10.42.42.10(pid=10555): Terminated {rc=256} 17:26:37.934712 --- ParallelTerminationStrategy: PID 10556 died... 17:26:37.953630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Terminated: ok {rc=0} 17:26:37.998197 --- ParallelTerminationStrategy: PID 10557 died... 17:26:38.017048 run iperf3-srv_10.42.42.10(pid=10557): Terminated {rc=256} 17:26:38.061449 --- ParallelTerminationStrategy: PID 10558 died... 17:26:38.080466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10558): Terminated: ok {rc=0} 17:26:38.125379 --- ParallelTerminationStrategy: PID 10559 died... 17:26:38.144177 run iperf3-srv_10.42.42.10(pid=10559): Terminated {rc=256} 17:26:38.188469 --- ParallelTerminationStrategy: PID 10560 died... 17:26:38.207404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10560): Terminated: ok {rc=0} 17:26:38.251704 --- ParallelTerminationStrategy: PID 10561 died... 17:26:38.270584 run iperf3-srv_10.42.42.10(pid=10561): Terminated {rc=256} 17:26:38.315178 --- ParallelTerminationStrategy: PID 10564 died... 17:26:38.334205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10564): Terminated: ok {rc=0} 17:26:38.378952 --- ParallelTerminationStrategy: PID 10567 died... 17:26:38.397986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10567): Terminated: ok {rc=0} 17:26:38.442542 --- ParallelTerminationStrategy: PID 10570 died... 17:26:38.461569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10570): Terminated: ok {rc=0} 17:26:38.548809 bus /gobi_4: Setting Powered False 17:26:39.651035 bus /gobi_4: Setting Powered False 17:26:40.769356 bus /gobi_1: Setting Powered False 17:26:41.869480 bus /gobi_1: Setting Powered False 17:26:42.982568 bus /gobi_0: Setting Powered False 17:26:44.082215 bus /gobi_0: Setting Powered False 17:26:45.203467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:26:46.308208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.321414 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:46.385375 tst ping.py: using LAC 35122 17:26:46.515836 tst ping.py: using RAC 187 17:26:46.670451 tst ping.py: using CellId 35122 17:26:46.792678 tst ping.py: using BVCI 35123 17:26:46.905762 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.917418 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.928650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.939980 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.951426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.962803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.974163 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:46.986208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:47.103800 tst ping.py:19: start network... 17:26:47.314885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:47.787523 run create_hlr_db(pid=10572): Launched 17:26:47.911666 bus /gobi_6: Setting Powered False 17:26:48.973278 run create_hlr_db(pid=10572): Terminated: ok {rc=0} 17:26:49.418099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10574): Launched 17:26:49.742615 run osmo-hlr_10.42.42.2(pid=10575): Launched 17:26:49.868001 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:50.437325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10577): Launched 17:26:50.761085 run osmo-stp_10.42.42.5(pid=10578): Launched 17:26:50.883758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:51.445694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10580): Launched 17:26:51.571130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:51.846637 run patchelf(pid=10581): Launched 17:26:52.030941 run osmo-stp_10.42.42.5(pid=10578): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10578)] 17:26:52.169393 run osmo-stp_10.42.42.5(pid=10578): stdout: | (launched: 2022-12-13_17:26:50.701939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:52.309605 run osmo-stp_10.42.42.5(pid=10578): stderr: | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172650891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:52.450351 run osmo-stp_10.42.42.5(pid=10578): stdout: | (launched: 2022-12-13_17:26:50.701939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:52.584161 run osmo-stp_10.42.42.5(pid=10578): stderr: | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172650891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172650891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172650892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:52.742800 run patchelf(pid=10581): Terminating (SIGINT) 17:26:52.926968 run patchelf(pid=10581): Terminated: ok {rc=0} 17:26:53.059905 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10578): Process ended prematurely: osmo-stp_10.42.42.5(pid=10578) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10578)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 17:26:53.069684 tst ping.py:22: Test FAILED (6.8 sec) 17:26:53.098140 run osmo-hlr_10.42.42.2(pid=10575): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10575)] 17:26:53.150296 run osmo-hlr_10.42.42.2(pid=10575): stdout: | (launched: 2022-12-13_17:26:49.683658) 17:26:53.204192 run osmo-hlr_10.42.42.2(pid=10575): stderr: | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172649877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172649888 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172649897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172649897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172649897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:53.258076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10574): Terminating (SIGTERM) 17:26:53.300771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10577): Terminating (SIGTERM) 17:26:53.344480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10580): Terminating (SIGTERM) 17:26:53.388295 --- ParallelTerminationStrategy: PID 10574 died... 17:26:53.409021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10574): Terminated: ok {rc=0} 17:26:53.456803 --- ParallelTerminationStrategy: PID 10577 died... 17:26:53.477545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10577): Terminated: ok {rc=0} 17:26:53.525184 --- ParallelTerminationStrategy: PID 10580 died... 17:26:53.545494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10580): Terminated: ok {rc=0} 17:26:53.635649 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:26:54.724124 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:54.736286 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:54.796918 tst ping_idle_ping.py: using LAC 35123 17:26:54.926908 tst ping_idle_ping.py: using RAC 188 17:26:55.056536 tst ping_idle_ping.py: using CellId 35123 17:26:55.186045 tst ping_idle_ping.py: using BVCI 35124 17:26:55.306476 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.318076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.329260 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.340411 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.351963 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.363486 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.375183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:55.386796 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:55.506377 tst ping_idle_ping.py:24: start network... 17:26:55.710768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:56.182048 run create_hlr_db(pid=10582): Launched 17:26:56.308927 bus /gobi_6: Setting Powered False 17:26:57.369916 run create_hlr_db(pid=10582): Terminated: ok {rc=0} 17:26:57.796396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10584): Launched 17:26:58.100682 run osmo-hlr_10.42.42.2(pid=10585): Launched 17:26:58.215327 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:58.738349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10587): Launched 17:26:59.042043 run osmo-stp_10.42.42.5(pid=10588): Launched 17:26:59.157603 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:59.682120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10590): Launched 17:26:59.798347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:00.055897 run patchelf(pid=10591): Launched 17:27:00.225248 run osmo-stp_10.42.42.5(pid=10588): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10588)] 17:27:00.354340 run osmo-stp_10.42.42.5(pid=10588): stdout: | (launched: 2022-12-13_17:26:58.986033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:00.485399 run osmo-stp_10.42.42.5(pid=10588): stderr: | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172659155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:00.617209 run osmo-stp_10.42.42.5(pid=10588): stdout: | (launched: 2022-12-13_17:26:58.986033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:00.741565 run osmo-stp_10.42.42.5(pid=10588): stderr: | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172659155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172659155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172659156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:00.890263 run patchelf(pid=10591): Terminating (SIGINT) 17:27:01.065770 run patchelf(pid=10591): Terminated: ok {rc=0} 17:27:01.192630 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10588): Process ended prematurely: osmo-stp_10.42.42.5(pid=10588) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10588)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:27:01.202337 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:27:01.230087 run osmo-hlr_10.42.42.2(pid=10585): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10585)] 17:27:01.279501 run osmo-hlr_10.42.42.2(pid=10585): stdout: | (launched: 2022-12-13_17:26:58.044819) 17:27:01.330572 run osmo-hlr_10.42.42.2(pid=10585): stderr: | [0;m[1;31m20221213172658219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172658219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172658219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172658219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172658219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172658220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172658252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172658261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172658262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172658262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:01.382205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10584): Terminating (SIGTERM) 17:27:01.423548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10587): Terminating (SIGTERM) 17:27:01.465265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10590): Terminating (SIGTERM) 17:27:01.508646 --- ParallelTerminationStrategy: PID 10584 died... 17:27:01.528639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10584): Terminated: ok {rc=0} 17:27:01.575439 --- ParallelTerminationStrategy: PID 10587 died... 17:27:01.594985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10587): Terminated: ok {rc=0} 17:27:01.640520 --- ParallelTerminationStrategy: PID 10590 died... 17:27:01.660241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10590): Terminated: ok {rc=0} 17:27:01.745959 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:27:03.041369 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:03.047247 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:27:03.067548 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:27:03.105513 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:27:03.192984 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:27:03.214055 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:27:03.279447 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:27:03.843524 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:27:03.893280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:03.903929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:03.960289 tst cs_paging_gprs_active.py: using LAC 35124 17:27:04.081954 tst cs_paging_gprs_active.py: using RAC 189 17:27:04.203988 tst cs_paging_gprs_active.py: using CellId 35124 17:27:04.328684 tst cs_paging_gprs_active.py: using BVCI 35125 17:27:04.441830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.452608 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.463169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.473815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.484203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.494741 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.505383 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.515872 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:04.527389 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:04.651702 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:04.771163 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:27:04.995216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:05.326924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10596): Launched 17:27:05.615167 run iperf3-srv_10.42.42.10(pid=10597): Launched 17:27:05.740581 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:27:05.964208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:06.295800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10598): Launched 17:27:06.584251 run iperf3-srv_10.42.42.10(pid=10599): Launched 17:27:06.707921 tst cs_paging_gprs_active.py:38: start network... 17:27:06.931604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:07.443526 run create_hlr_db(pid=10600): Launched 17:27:07.569784 bus /gobi_6: Setting Powered False 17:27:08.634798 run create_hlr_db(pid=10600): Terminated: ok {rc=0} 17:27:09.078535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Launched 17:27:09.389758 run osmo-hlr_10.42.42.2(pid=10603): Launched 17:27:09.506508 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:10.039476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Launched 17:27:10.350638 run osmo-stp_10.42.42.5(pid=10606): Launched 17:27:10.470059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:11.005208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Launched 17:27:11.124008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:11.385992 run patchelf(pid=10609): Launched 17:27:11.558364 run osmo-stp_10.42.42.5(pid=10606): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] 17:27:11.689852 run osmo-stp_10.42.42.5(pid=10606): stdout: | (launched: 2022-12-13_17:27:10.293983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:11.823105 run osmo-stp_10.42.42.5(pid=10606): stderr: | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172710463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:11.956441 run osmo-stp_10.42.42.5(pid=10606): stdout: | (launched: 2022-12-13_17:27:10.293983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:12.083067 run osmo-stp_10.42.42.5(pid=10606): stderr: | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172710463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:12.233252 run patchelf(pid=10609): Terminating (SIGINT) 17:27:12.409069 run patchelf(pid=10609): Terminated: ok {rc=0} 17:27:12.535879 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10606): Process ended prematurely: osmo-stp_10.42.42.5(pid=10606) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:27:12.545428 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:27:12.572374 run osmo-hlr_10.42.42.2(pid=10603): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10603)] 17:27:12.620842 run osmo-hlr_10.42.42.2(pid=10603): stdout: | (launched: 2022-12-13_17:27:09.331931) 17:27:12.670582 run osmo-hlr_10.42.42.2(pid=10603): stderr: | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172709507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172709519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172709527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172709528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172709528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:12.720839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10596): Terminating (SIGTERM) 17:27:12.760873 run iperf3-srv_10.42.42.10(pid=10597): Terminating (SIGTERM) 17:27:12.800652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10598): Terminating (SIGTERM) 17:27:12.840520 run iperf3-srv_10.42.42.10(pid=10599): Terminating (SIGTERM) 17:27:12.880313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Terminating (SIGTERM) 17:27:12.920212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Terminating (SIGTERM) 17:27:12.960245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Terminating (SIGTERM) 17:27:13.000438 --- ParallelTerminationStrategy: PID 10596 died... 17:27:13.019793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10596): Terminated: ok {rc=0} 17:27:13.064031 --- ParallelTerminationStrategy: PID 10597 died... 17:27:13.082669 run iperf3-srv_10.42.42.10(pid=10597): Terminated {rc=256} 17:27:13.126675 --- ParallelTerminationStrategy: PID 10598 died... 17:27:13.145294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10598): Terminated: ok {rc=0} 17:27:13.189157 --- ParallelTerminationStrategy: PID 10599 died... 17:27:13.207739 run iperf3-srv_10.42.42.10(pid=10599): Terminated {rc=256} 17:27:13.251652 --- ParallelTerminationStrategy: PID 10602 died... 17:27:13.270354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Terminated: ok {rc=0} 17:27:13.314315 --- ParallelTerminationStrategy: PID 10605 died... 17:27:13.333022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Terminated: ok {rc=0} 17:27:13.377198 --- ParallelTerminationStrategy: PID 10608 died... 17:27:13.395887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Terminated: ok {rc=0} 17:27:13.483222 bus /gobi_0: Setting Powered False 17:27:14.584735 bus /gobi_0: Setting Powered False 17:27:15.700121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:27:16.851423 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:16.864573 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:16.927747 tst iperf3.py: using LAC 35125 17:27:17.059980 tst iperf3.py: using RAC 190 17:27:17.205634 tst iperf3.py: using CellId 35125 17:27:17.336127 tst iperf3.py: using BVCI 35126 17:27:17.459614 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.471270 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.482746 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.494113 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.505892 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.517572 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.529486 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.541549 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:17.553547 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:17.671769 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:17.879175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:18.188541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10610): Launched 17:27:18.457806 run iperf3-srv_10.42.42.10(pid=10611): Launched 17:27:18.573417 tst iperf3.py:8: start network... 17:27:18.780593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:19.257559 run create_hlr_db(pid=10612): Launched 17:27:19.384055 bus /gobi_6: Setting Powered False 17:27:20.446069 run create_hlr_db(pid=10612): Terminated: ok {rc=0} 17:27:20.897624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10614): Launched 17:27:21.230448 run osmo-hlr_10.42.42.2(pid=10615): Launched 17:27:21.358471 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:21.932676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10617): Launched 17:27:22.261843 run osmo-stp_10.42.42.5(pid=10618): Launched 17:27:22.388002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:22.955969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10620): Launched 17:27:23.082685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:23.361166 run patchelf(pid=10621): Launched 17:27:23.544731 run osmo-stp_10.42.42.5(pid=10618): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10618)] 17:27:23.685062 run osmo-stp_10.42.42.5(pid=10618): stdout: | (launched: 2022-12-13_17:27:22.202204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:23.826167 run osmo-stp_10.42.42.5(pid=10618): stderr: | [0;m[38;5;43m20221213172722391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172722391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172722392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172722392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:23.968180 run osmo-stp_10.42.42.5(pid=10618): stdout: | (launched: 2022-12-13_17:27:22.202204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:24.103311 run osmo-stp_10.42.42.5(pid=10618): stderr: | [0;m[38;5;43m20221213172722391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172722391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172722392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172722392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172722393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:24.263065 run patchelf(pid=10621): Terminating (SIGINT) 17:27:24.450677 run patchelf(pid=10621): Terminated: ok {rc=0} 17:27:24.585434 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10618): Process ended prematurely: osmo-stp_10.42.42.5(pid=10618) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10618)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 17:27:24.595721 tst iperf3.py:8: Test FAILED (7.8 sec) 17:27:24.624324 run osmo-hlr_10.42.42.2(pid=10615): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10615)] 17:27:24.675801 run osmo-hlr_10.42.42.2(pid=10615): stdout: | (launched: 2022-12-13_17:27:21.170545) 17:27:24.729314 run osmo-hlr_10.42.42.2(pid=10615): stderr: | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172721366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172721378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172721387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172721387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172721387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:24.782663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10610): Terminating (SIGTERM) 17:27:24.825110 run iperf3-srv_10.42.42.10(pid=10611): Terminating (SIGTERM) 17:27:24.868376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10614): Terminating (SIGTERM) 17:27:24.911216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10617): Terminating (SIGTERM) 17:27:24.954444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10620): Terminating (SIGTERM) 17:27:24.997386 --- ParallelTerminationStrategy: PID 10610 died... 17:27:25.018056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10610): Terminated: ok {rc=0} 17:27:25.065035 --- ParallelTerminationStrategy: PID 10611 died... 17:27:25.085106 run iperf3-srv_10.42.42.10(pid=10611): Terminated {rc=256} 17:27:25.131918 --- ParallelTerminationStrategy: PID 10614 died... 17:27:25.151928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10614): Terminated: ok {rc=0} 17:27:25.199071 --- ParallelTerminationStrategy: PID 10617 died... 17:27:25.219046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10617): Terminated: ok {rc=0} 17:27:25.265967 --- ParallelTerminationStrategy: PID 10620 died... 17:27:25.286052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10620): Terminated: ok {rc=0} 17:27:25.376314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:27:26.529681 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:26.541746 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:26.600573 tst iperf3m4.py: using LAC 35126 17:27:26.731332 tst iperf3m4.py: using RAC 191 17:27:26.859971 tst iperf3m4.py: using CellId 35126 17:27:26.991524 tst iperf3m4.py: using BVCI 35127 17:27:27.111590 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.123250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.134516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.145778 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.157160 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.169007 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.180583 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.192106 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:27.203701 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:27.323404 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:27.448221 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:27.568938 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:27.687562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:27.894933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:28.206068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10622): Launched 17:27:28.479859 run iperf3-srv_10.42.42.10(pid=10623): Launched 17:27:28.596456 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:27:28.803292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:29.112694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Launched 17:27:29.382302 run iperf3-srv_10.42.42.10(pid=10625): Launched 17:27:29.500079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:27:29.706106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:30.016885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Launched 17:27:30.286706 run iperf3-srv_10.42.42.10(pid=10627): Launched 17:27:30.404496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:27:30.610576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:30.938477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10628): Launched 17:27:31.225172 run iperf3-srv_10.42.42.10(pid=10629): Launched 17:27:31.357660 tst iperf3m4.py:8: start network... 17:27:31.568458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:32.059035 run create_hlr_db(pid=10630): Launched 17:27:32.214998 bus /gobi_6: Setting Powered False 17:27:33.276498 run create_hlr_db(pid=10630): Terminated: ok {rc=0} 17:27:33.707689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Launched 17:27:34.017517 run osmo-hlr_10.42.42.2(pid=10633): Launched 17:27:34.135419 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:34.670348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Launched 17:27:34.980054 run osmo-stp_10.42.42.5(pid=10636): Launched 17:27:35.097208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:35.629786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Launched 17:27:35.748147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:36.009711 run patchelf(pid=10639): Launched 17:27:36.182755 run osmo-stp_10.42.42.5(pid=10636): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] 17:27:36.313996 run osmo-stp_10.42.42.5(pid=10636): stdout: | (launched: 2022-12-13_17:27:34.922735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:36.447215 run osmo-stp_10.42.42.5(pid=10636): stderr: | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172735093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:36.580472 run osmo-stp_10.42.42.5(pid=10636): stdout: | (launched: 2022-12-13_17:27:34.922735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:36.707046 run osmo-stp_10.42.42.5(pid=10636): stderr: | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172735093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172735093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172735094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:36.858230 run patchelf(pid=10639): Terminating (SIGINT) 17:27:37.035055 run patchelf(pid=10639): Terminated: ok {rc=0} 17:27:37.162098 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10636): Process ended prematurely: osmo-stp_10.42.42.5(pid=10636) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:27:37.171559 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:27:37.199172 run osmo-hlr_10.42.42.2(pid=10633): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10633)] 17:27:37.247739 run osmo-hlr_10.42.42.2(pid=10633): stdout: | (launched: 2022-12-13_17:27:33.960185) 17:27:37.298254 run osmo-hlr_10.42.42.2(pid=10633): stderr: | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172734134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172734146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172734154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172734154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172734154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:37.348867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10622): Terminating (SIGTERM) 17:27:37.389351 run iperf3-srv_10.42.42.10(pid=10623): Terminating (SIGTERM) 17:27:37.429440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Terminating (SIGTERM) 17:27:37.469589 run iperf3-srv_10.42.42.10(pid=10625): Terminating (SIGTERM) 17:27:37.509813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Terminating (SIGTERM) 17:27:37.550640 run iperf3-srv_10.42.42.10(pid=10627): Terminating (SIGTERM) 17:27:37.590739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10628): Terminating (SIGTERM) 17:27:37.630785 run iperf3-srv_10.42.42.10(pid=10629): Terminating (SIGTERM) 17:27:37.670875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Terminating (SIGTERM) 17:27:37.711018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Terminating (SIGTERM) 17:27:37.750981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Terminating (SIGTERM) 17:27:37.791434 --- ParallelTerminationStrategy: PID 10622 died... 17:27:37.810858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10622): Terminated: ok {rc=0} 17:27:37.855294 --- ParallelTerminationStrategy: PID 10623 died... 17:27:37.874152 run iperf3-srv_10.42.42.10(pid=10623): Terminated {rc=256} 17:27:37.918424 --- ParallelTerminationStrategy: PID 10624 died... 17:27:37.937514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10624): Terminated: ok {rc=0} 17:27:37.982031 --- ParallelTerminationStrategy: PID 10625 died... 17:27:38.000808 run iperf3-srv_10.42.42.10(pid=10625): Terminated {rc=256} 17:27:38.045078 --- ParallelTerminationStrategy: PID 10626 died... 17:27:38.063999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10626): Terminated: ok {rc=0} 17:27:38.108231 --- ParallelTerminationStrategy: PID 10627 died... 17:27:38.127020 run iperf3-srv_10.42.42.10(pid=10627): Terminated {rc=256} 17:27:38.171295 --- ParallelTerminationStrategy: PID 10628 died... 17:27:38.190131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10628): Terminated: ok {rc=0} 17:27:38.234546 --- ParallelTerminationStrategy: PID 10629 died... 17:27:38.253514 run iperf3-srv_10.42.42.10(pid=10629): Terminated {rc=256} 17:27:38.297691 --- ParallelTerminationStrategy: PID 10632 died... 17:27:38.316760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Terminated: ok {rc=0} 17:27:38.361318 --- ParallelTerminationStrategy: PID 10635 died... 17:27:38.380252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Terminated: ok {rc=0} 17:27:38.424693 --- ParallelTerminationStrategy: PID 10638 died... 17:27:38.443875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Terminated: ok {rc=0} 17:27:38.548041 bus /gobi_4: Setting Powered False 17:27:39.696436 bus /gobi_4: Setting Powered False 17:27:40.816439 bus /gobi_1: Setting Powered False 17:27:41.917372 bus /gobi_1: Setting Powered False 17:27:43.037563 bus /gobi_0: Setting Powered False 17:27:44.137372 bus /gobi_0: Setting Powered False 17:27:45.257060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:27:46.359179 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:46.371195 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:46.433904 tst ping.py: using LAC 35127 17:27:46.596052 tst ping.py: using RAC 192 17:27:46.722741 tst ping.py: using CellId 35127 17:27:46.854189 tst ping.py: using BVCI 35128 17:27:46.969327 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:46.980559 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:46.991619 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.002657 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.013573 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.025698 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.037237 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.048405 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:47.166171 tst ping.py:19: start network... 17:27:47.373282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:47.843563 run create_hlr_db(pid=10640): Launched 17:27:47.966734 bus /gobi_6: Setting Powered False 17:27:49.028350 run create_hlr_db(pid=10640): Terminated: ok {rc=0} 17:27:49.473910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10642): Launched 17:27:49.799180 run osmo-hlr_10.42.42.2(pid=10643): Launched 17:27:49.923963 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:50.489909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10645): Launched 17:27:50.814116 run osmo-stp_10.42.42.5(pid=10646): Launched 17:27:50.937720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:51.497552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10648): Launched 17:27:51.622352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:51.897909 run patchelf(pid=10649): Launched 17:27:52.078914 run osmo-stp_10.42.42.5(pid=10646): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10646)] 17:27:52.216552 run osmo-stp_10.42.42.5(pid=10646): stdout: | (launched: 2022-12-13_17:27:50.755092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:52.356253 run osmo-stp_10.42.42.5(pid=10646): stderr: | [0;m[38;5;43m20221213172750943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172750944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172750944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172750944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:52.496110 run osmo-stp_10.42.42.5(pid=10646): stdout: | (launched: 2022-12-13_17:27:50.755092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:52.629347 run osmo-stp_10.42.42.5(pid=10646): stderr: | [0;m[38;5;43m20221213172750943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172750944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172750944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172750944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172750945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:52.787700 run patchelf(pid=10649): Terminating (SIGINT) 17:27:52.971941 run patchelf(pid=10649): Terminated: ok {rc=0} 17:27:53.104705 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10646): Process ended prematurely: osmo-stp_10.42.42.5(pid=10646) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10646)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 17:27:53.114551 tst ping.py:22: Test FAILED (6.7 sec) 17:27:53.143096 run osmo-hlr_10.42.42.2(pid=10643): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10643)] 17:27:53.194820 run osmo-hlr_10.42.42.2(pid=10643): stdout: | (launched: 2022-12-13_17:27:49.739960) 17:27:53.248622 run osmo-hlr_10.42.42.2(pid=10643): stderr: | [0;m[1;31m20221213172749934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172749934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172749934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172749935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172749935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172749935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172749946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172749956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172749956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172749956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:53.302646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10642): Terminating (SIGTERM) 17:27:53.346089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10645): Terminating (SIGTERM) 17:27:53.389328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10648): Terminating (SIGTERM) 17:27:53.432858 --- ParallelTerminationStrategy: PID 10642 died... 17:27:53.453796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10642): Terminated: ok {rc=0} 17:27:53.501626 --- ParallelTerminationStrategy: PID 10645 died... 17:27:53.522060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10645): Terminated: ok {rc=0} 17:27:53.569564 --- ParallelTerminationStrategy: PID 10648 died... 17:27:53.589850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10648): Terminated: ok {rc=0} 17:27:53.680327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:27:54.768348 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:54.780601 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:54.841427 tst ping_idle_ping.py: using LAC 35128 17:27:54.969997 tst ping_idle_ping.py: using RAC 193 17:27:55.098044 tst ping_idle_ping.py: using CellId 35128 17:27:55.224528 tst ping_idle_ping.py: using BVCI 35129 17:27:55.342723 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.354355 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.365708 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.376747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.388199 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.399763 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.411424 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:55.422924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:55.541227 tst ping_idle_ping.py:24: start network... 17:27:55.746402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:56.224893 run create_hlr_db(pid=10650): Launched 17:27:56.350425 bus /gobi_6: Setting Powered False 17:27:57.410626 run create_hlr_db(pid=10650): Terminated: ok {rc=0} 17:27:57.836321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10652): Launched 17:27:58.140238 run osmo-hlr_10.42.42.2(pid=10653): Launched 17:27:58.254781 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:58.776656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10655): Launched 17:27:59.082581 run osmo-stp_10.42.42.5(pid=10656): Launched 17:27:59.198027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:59.722366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10658): Launched 17:27:59.838505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:00.095827 run patchelf(pid=10659): Launched 17:28:00.264711 run osmo-stp_10.42.42.5(pid=10656): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10656)] 17:28:00.393463 run osmo-stp_10.42.42.5(pid=10656): stdout: | (launched: 2022-12-13_17:27:59.026699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:00.524225 run osmo-stp_10.42.42.5(pid=10656): stderr: | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172759194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:00.655197 run osmo-stp_10.42.42.5(pid=10656): stdout: | (launched: 2022-12-13_17:27:59.026699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:00.779801 run osmo-stp_10.42.42.5(pid=10656): stderr: | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172759194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172759194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172759195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:00.928691 run patchelf(pid=10659): Terminating (SIGINT) 17:28:01.105191 run patchelf(pid=10659): Terminated: ok {rc=0} 17:28:01.232285 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10656): Process ended prematurely: osmo-stp_10.42.42.5(pid=10656) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10656)] [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:28:01.241983 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:28:01.269853 run osmo-hlr_10.42.42.2(pid=10653): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10653)] 17:28:01.319899 run osmo-hlr_10.42.42.2(pid=10653): stdout: | (launched: 2022-12-13_17:27:58.084111) 17:28:01.371158 run osmo-hlr_10.42.42.2(pid=10653): stderr: | [0;m[1;31m20221213172758260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172758260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172758260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172758261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172758261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172758261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172758273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172758282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172758282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172758282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:01.423269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10652): Terminating (SIGTERM) 17:28:01.465069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10655): Terminating (SIGTERM) 17:28:01.506651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10658): Terminating (SIGTERM) 17:28:01.548245 --- ParallelTerminationStrategy: PID 10652 died... 17:28:01.568580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10652): Terminated: ok {rc=0} 17:28:01.615809 --- ParallelTerminationStrategy: PID 10655 died... 17:28:01.635624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10655): Terminated: ok {rc=0} 17:28:01.681033 --- ParallelTerminationStrategy: PID 10658 died... 17:28:01.700204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10658): Terminated: ok {rc=0} 17:28:01.788886 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:28:03.089157 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:03.097084 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:28:03.118706 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:28:03.155306 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:28:03.208854 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:28:03.229640 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:28:03.264023 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:28:03.824709 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:28:03.831028 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:03.843200 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:28:03.900907 tst switch_tch_pdch.py: using LAC 35129 17:28:04.026845 tst switch_tch_pdch.py: using RAC 194 17:28:04.153674 tst switch_tch_pdch.py: using CellId 35129 17:28:04.281081 tst switch_tch_pdch.py: using BVCI 35130 17:28:04.398741 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.410509 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.422016 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.433522 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.445152 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.456779 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.469305 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:28:04.481219 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:28:04.599237 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:28:04.721782 tst switch_tch_pdch.py:51: start network... 17:28:04.941183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:05.443821 run create_hlr_db(pid=10663): Launched 17:28:05.567082 bus /gobi_6: Setting Powered False 17:28:06.631706 run create_hlr_db(pid=10663): Terminated: ok {rc=0} 17:28:07.068442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10665): Launched 17:28:07.372318 run osmo-hlr_10.42.42.2(pid=10666): Launched 17:28:07.488064 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:08.015789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10668): Launched 17:28:08.319470 run osmo-stp_10.42.42.5(pid=10669): Launched 17:28:08.435134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:08.958013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10671): Launched 17:28:09.074765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:09.331081 run patchelf(pid=10672): Launched 17:28:09.499300 run osmo-stp_10.42.42.5(pid=10669): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10669)] 17:28:09.627637 run osmo-stp_10.42.42.5(pid=10669): stdout: | (launched: 2022-12-13_17:28:08.263950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:09.758120 run osmo-stp_10.42.42.5(pid=10669): stderr: | [0;m[38;5;43m20221213172808429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172808429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172808430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172808430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:09.888185 run osmo-stp_10.42.42.5(pid=10669): stdout: | (launched: 2022-12-13_17:28:08.263950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:10.011766 run osmo-stp_10.42.42.5(pid=10669): stderr: | [0;m[38;5;43m20221213172808429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172808429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172808430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172808430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172808431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:10.158617 run patchelf(pid=10672): Terminating (SIGINT) 17:28:10.330663 run patchelf(pid=10672): Terminated: ok {rc=0} 17:28:10.454089 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10669): Process ended prematurely: osmo-stp_10.42.42.5(pid=10669) [trial-2392↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10669)] [trial-2392↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:28:10.463042 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:28:10.489624 run osmo-hlr_10.42.42.2(pid=10666): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10666)] 17:28:10.537445 run osmo-hlr_10.42.42.2(pid=10666): stdout: | (launched: 2022-12-13_17:28:07.316495) 17:28:10.586975 run osmo-hlr_10.42.42.2(pid=10666): stderr: | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172807489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172807502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172807513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172807513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172807513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:10.637281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10665): Terminating (SIGTERM) 17:28:10.677121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10668): Terminating (SIGTERM) 17:28:10.716882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10671): Terminating (SIGTERM) 17:28:10.756888 --- ParallelTerminationStrategy: PID 10665 died... 17:28:10.776182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10665): Terminated: ok {rc=0} 17:28:10.821355 --- ParallelTerminationStrategy: PID 10668 died... 17:28:10.839986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10668): Terminated: ok {rc=0} 17:28:10.884243 --- ParallelTerminationStrategy: PID 10671 died... 17:28:10.902950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10671): Terminated: ok {rc=0} 17:28:10.989378 bus /gobi_0: Setting Powered False 17:28:12.091914 bus /gobi_0: Setting Powered False 17:28:13.205721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:28:14.448430 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:14.454764 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:28:14.475840 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:28:14.512091 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:28:14.565276 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:28:14.586853 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:28:14.622858 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:28:15.179755 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:28:15.185473 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.196927 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:28:15.253233 tst switch_tch_pdch.py: using LAC 35130 17:28:15.381311 tst switch_tch_pdch.py: using RAC 195 17:28:15.506391 tst switch_tch_pdch.py: using CellId 35130 17:28:15.631455 tst switch_tch_pdch.py: using BVCI 35131 17:28:15.749525 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.760847 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.772143 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.783329 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.794864 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.806511 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.818470 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:15.834366 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:15.968915 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:16.103667 tst switch_tch_pdch.py:51: start network... 17:28:16.327079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:16.814264 run create_hlr_db(pid=10676): Launched 17:28:16.965984 bus /gobi_6: Setting Powered False 17:28:18.030220 run create_hlr_db(pid=10676): Terminated: ok {rc=0} 17:28:18.439931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10678): Launched 17:28:18.744636 run osmo-hlr_10.42.42.2(pid=10679): Launched 17:28:18.859245 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:19.369162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10681): Launched 17:28:19.671264 run osmo-stp_10.42.42.5(pid=10682): Launched 17:28:19.785939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:20.282188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10684): Launched 17:28:20.398088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:20.654138 run patchelf(pid=10685): Launched 17:28:20.822118 run osmo-stp_10.42.42.5(pid=10682): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10682)] 17:28:20.950507 run osmo-stp_10.42.42.5(pid=10682): stdout: | (launched: 2022-12-13_17:28:19.615616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:21.080891 run osmo-stp_10.42.42.5(pid=10682): stderr: | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172819781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:21.212220 run osmo-stp_10.42.42.5(pid=10682): stdout: | (launched: 2022-12-13_17:28:19.615616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:21.336036 run osmo-stp_10.42.42.5(pid=10682): stderr: | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172819781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172819781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172819782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:21.483227 run patchelf(pid=10685): Terminating (SIGINT) 17:28:21.654623 run patchelf(pid=10685): Terminated: ok {rc=0} 17:28:21.778343 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10682): Process ended prematurely: osmo-stp_10.42.42.5(pid=10682) [trial-2392↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10682)] [trial-2392↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:28:21.787166 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:28:21.813625 run osmo-hlr_10.42.42.2(pid=10679): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10679)] 17:28:21.861570 run osmo-hlr_10.42.42.2(pid=10679): stdout: | (launched: 2022-12-13_17:28:18.688455) 17:28:21.911117 run osmo-hlr_10.42.42.2(pid=10679): stderr: | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172818863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172818875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172818886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172818886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172818886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:21.961812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10678): Terminating (SIGTERM) 17:28:22.002082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10681): Terminating (SIGTERM) 17:28:22.042155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10684): Terminating (SIGTERM) 17:28:22.082196 --- ParallelTerminationStrategy: PID 10678 died... 17:28:22.101329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10678): Terminated: ok {rc=0} 17:28:22.145432 --- ParallelTerminationStrategy: PID 10681 died... 17:28:22.163882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10681): Terminated: ok {rc=0} 17:28:22.208073 --- ParallelTerminationStrategy: PID 10684 died... 17:28:22.226776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10684): Terminated: ok {rc=0} 17:28:22.313065 bus /gobi_0: Setting Powered False 17:28:23.412680 bus /gobi_0: Setting Powered False 17:28:24.528669 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:trx-b200 --------------------------------------------------------------------- 17:28:25.768130 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:25.772380 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:25.806184 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:25.813754 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:25.865957 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:25.900326 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:25.907661 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:26.447951 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:26.453118 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:26.463862 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:26.511936 tst mo_mt_sms.py: using LAC 35131 17:28:26.633614 tst mo_mt_sms.py: using RAC 196 17:28:26.752519 tst mo_mt_sms.py: using CellId 35131 17:28:26.875010 tst mo_mt_sms.py: using BVCI 35132 17:28:26.985683 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:27.106830 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:27.223994 tst mo_mt_sms.py:9: start nitb and bts... 17:28:27.429399 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:28.051236 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10690): Launched 17:28:28.355434 run osmo-nitb_10.42.42.2(pid=10691): Launched 17:28:28.523376 run osmo-nitb_10.42.42.2(pid=10691): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10691)] 17:28:28.660091 run osmo-nitb_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-13_17:28:28.299461) 17:28:28.798486 run osmo-nitb_10.42.42.2(pid=10691): stderr: | (launched: 2022-12-13_17:28:28.344441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:28.936304 run osmo-nitb_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-13_17:28:28.299461) 17:28:29.068328 run osmo-nitb_10.42.42.2(pid=10691): stderr: | (launched: 2022-12-13_17:28:28.344441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10691) [trial-2392↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10691)] 17:28:29.470114 tst osmo-nitb_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-13_17:28:28.299461) 17:28:29.593655 tst osmo-nitb_10.42.42.2(pid=10691): stderr: | (launched: 2022-12-13_17:28:28.344441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:29.738575 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10691) [trial-2392↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10691)] [trial-2392↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 17:28:29.747132 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 17:28:29.753903 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10690): Terminating (SIGTERM) 17:28:29.963262 --- ParallelTerminationStrategy: PID 10690 died... 17:28:29.984326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10690): Terminated: ok {rc=0} 17:28:30.069497 bus /sierra_3: Setting Powered False 17:28:31.176030 bus /sierra_3: Setting Powered False 17:28:32.308361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:trx-b200 --------------------------------------------------------------------- 17:28:33.511964 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:33.516305 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:33.550206 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:33.579007 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:33.631588 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:33.666002 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:33.693771 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:34.238864 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:34.243809 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.254484 tst sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:34.300942 tst mo_mt_sms.py: using LAC 35132 17:28:34.420265 tst mo_mt_sms.py: using RAC 197 17:28:34.541105 tst mo_mt_sms.py: using CellId 35132 17:28:34.660700 tst mo_mt_sms.py: using BVCI 35133 17:28:34.769655 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.780096 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.790517 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.800776 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.811098 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:34.821416 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:34.943208 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:35.061078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:35.531815 run create_hlr_db(pid=10696): Launched 17:28:35.656083 bus /sierra_2: Setting Powered False 17:28:36.716334 run create_hlr_db(pid=10696): Terminated: ok {rc=0} 17:28:37.163472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Launched 17:28:37.489156 run osmo-hlr_10.42.42.2(pid=10699): Launched 17:28:37.612685 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:38.172608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Launched 17:28:38.497449 run osmo-stp_10.42.42.5(pid=10702): Launched 17:28:38.623157 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:39.212528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10704): Launched 17:28:39.536915 run osmo-msc_10.42.42.6(pid=10705): Launched 17:28:39.717932 run osmo-stp_10.42.42.5(pid=10702): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] 17:28:39.855201 run osmo-stp_10.42.42.5(pid=10702): stdout: | (launched: 2022-12-13_17:28:38.438437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:39.993512 run osmo-stp_10.42.42.5(pid=10702): stderr: | [0;m[38;5;43m20221213172838625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172838625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172838626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172838626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:40.128927 run osmo-stp_10.42.42.5(pid=10702): stdout: | (launched: 2022-12-13_17:28:38.438437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:40.258422 run osmo-stp_10.42.42.5(pid=10702): stderr: | [0;m[38;5;43m20221213172838625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172838625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172838626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172838626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172838627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:40.413698 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10702): Process ended prematurely: osmo-stp_10.42.42.5(pid=10702) [trial-2392↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] [trial-2392↪sms:trx-b200↪mo_mt_sms.py:16] 17:28:40.422649 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 17:28:40.450326 run osmo-hlr_10.42.42.2(pid=10699): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10699)] 17:28:40.502333 run osmo-hlr_10.42.42.2(pid=10699): stdout: | (launched: 2022-12-13_17:28:37.429813) 17:28:40.555404 run osmo-hlr_10.42.42.2(pid=10699): stderr: | [0;m[1;31m20221213172837623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172837624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172837624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172837624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172837624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172837624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172837637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172837645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172837645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172837645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:40.629638 run osmo-msc_10.42.42.6(pid=10705): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10705)] 17:28:40.680589 run osmo-msc_10.42.42.6(pid=10705): stdout: | (launched: 2022-12-13_17:28:39.477792) 17:28:40.734056 run osmo-msc_10.42.42.6(pid=10705): stderr: | [0;m[38;5;43m20221213172839795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172839795 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1a5dc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172839795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172839795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172839795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172839795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172839797 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172839797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172839798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172839798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:40.787639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Terminating (SIGTERM) 17:28:40.830094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Terminating (SIGTERM) 17:28:40.873311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10704): Terminating (SIGTERM) 17:28:40.916200 --- ParallelTerminationStrategy: PID 10698 died... 17:28:40.936926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Terminated: ok {rc=0} 17:28:40.984814 --- ParallelTerminationStrategy: PID 10701 died... 17:28:41.005393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Terminated: ok {rc=0} 17:28:41.052476 --- ParallelTerminationStrategy: PID 10704 died... 17:28:41.072605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10704): Terminated: ok {rc=0} 17:28:41.162277 bus /sierra_3: Setting Powered False 17:28:42.262335 bus /sierra_3: Setting Powered False 17:28:43.380045 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-b200 --------------------------------------------------------------------- 17:28:44.609104 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:44.613270 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:44.645816 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:44.652450 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:44.687238 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:44.720312 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:44.727010 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:45.248196 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:45.253090 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:45.263763 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:45.310485 tst assert_extension.py: using LAC 35133 17:28:45.431973 tst assert_extension.py: using RAC 198 17:28:45.552386 tst assert_extension.py: using CellId 35133 17:28:45.673228 tst assert_extension.py: using BVCI 35134 17:28:45.782882 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:45.903337 tst assert_extension.py:10: start nitb and bts... 17:28:46.155721 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:46.838424 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10710): Launched 17:28:47.176347 run osmo-nitb_10.42.42.2(pid=10711): Launched 17:28:47.356728 run osmo-nitb_10.42.42.2(pid=10711): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10711)] 17:28:47.502893 run osmo-nitb_10.42.42.2(pid=10711): stdout: | (launched: 2022-12-13_17:28:47.116519) 17:28:47.650301 run osmo-nitb_10.42.42.2(pid=10711): stderr: | (launched: 2022-12-13_17:28:47.165506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:47.797607 run osmo-nitb_10.42.42.2(pid=10711): stdout: | (launched: 2022-12-13_17:28:47.116519) 17:28:47.938436 run osmo-nitb_10.42.42.2(pid=10711): stderr: | (launched: 2022-12-13_17:28:47.165506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10711): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10711) [trial-2392↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10711)] 17:28:48.299013 tst osmo-nitb_10.42.42.2(pid=10711): stdout: | (launched: 2022-12-13_17:28:47.116519) 17:28:48.422090 tst osmo-nitb_10.42.42.2(pid=10711): stderr: | (launched: 2022-12-13_17:28:47.165506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:48.566643 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10711): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10711) [trial-2392↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10711)] [trial-2392↪nitb_ussd:trx-b200↪assert_extension.py:12] 17:28:48.574981 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:28:48.581742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10710): Terminating (SIGTERM) 17:28:48.790759 --- ParallelTerminationStrategy: PID 10710 died... 17:28:48.811878 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10710): Terminated: ok {rc=0} 17:28:48.899898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:trx-b200 --------------------------------------------------------------------- 17:28:50.082637 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:50.086939 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:50.121141 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:50.149441 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:50.185877 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:50.220358 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:50.248089 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:50.775696 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:50.780850 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:50.792206 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:50.841168 tst assert_extension.py: using LAC 35134 17:28:50.966947 tst assert_extension.py: using RAC 199 17:28:51.100490 tst assert_extension.py: using CellId 35134 17:28:51.227475 tst assert_extension.py: using BVCI 35135 17:28:51.345527 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:51.356432 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:51.367364 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:51.378306 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:51.389639 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:51.400780 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:51.519329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:51.988209 run create_hlr_db(pid=10715): Launched 17:28:52.111946 bus /sierra_2: Setting Powered False 17:28:53.177094 run create_hlr_db(pid=10715): Terminated: ok {rc=0} 17:28:53.630246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10717): Launched 17:28:53.956465 run osmo-hlr_10.42.42.2(pid=10718): Launched 17:28:54.080448 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:54.640761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10720): Launched 17:28:54.966096 run osmo-stp_10.42.42.5(pid=10721): Launched 17:28:55.089775 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:55.675097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10723): Launched 17:28:56.000681 run osmo-msc_10.42.42.6(pid=10724): Launched 17:28:56.180798 run osmo-stp_10.42.42.5(pid=10721): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10721)] 17:28:56.318691 run osmo-stp_10.42.42.5(pid=10721): stdout: | (launched: 2022-12-13_17:28:54.906562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:56.456940 run osmo-stp_10.42.42.5(pid=10721): stderr: | [0;m[38;5;43m20221213172855095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172855095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172855096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172855096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:56.593532 run osmo-stp_10.42.42.5(pid=10721): stdout: | (launched: 2022-12-13_17:28:54.906562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:56.723222 run osmo-stp_10.42.42.5(pid=10721): stderr: | [0;m[38;5;43m20221213172855095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172855095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172855096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172855096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172855097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:56.878396 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10721): Process ended prematurely: osmo-stp_10.42.42.5(pid=10721) [trial-2392↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10721)] [trial-2392↪ussd:trx-b200↪assert_extension.py:17] 17:28:56.887529 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:28:56.915406 run osmo-hlr_10.42.42.2(pid=10718): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10718)] 17:28:56.968152 run osmo-hlr_10.42.42.2(pid=10718): stdout: | (launched: 2022-12-13_17:28:53.896878) 17:28:57.021893 run osmo-hlr_10.42.42.2(pid=10718): stderr: | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172854093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172854106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172854114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172854114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172854114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:57.096280 run osmo-msc_10.42.42.6(pid=10724): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10724)] 17:28:57.147300 run osmo-msc_10.42.42.6(pid=10724): stdout: | (launched: 2022-12-13_17:28:55.941310) 17:28:57.200859 run osmo-msc_10.42.42.6(pid=10724): stderr: | [0;m[38;5;43m20221213172856261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172856262 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad74026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172856262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172856262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172856262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172856262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172856264 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172856264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172856264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172856265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:57.254457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10717): Terminating (SIGTERM) 17:28:57.297181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10720): Terminating (SIGTERM) 17:28:57.340669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10723): Terminating (SIGTERM) 17:28:57.384056 --- ParallelTerminationStrategy: PID 10717 died... 17:28:57.404844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10717): Terminated: ok {rc=0} 17:28:57.452488 --- ParallelTerminationStrategy: PID 10720 died... 17:28:57.472796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10720): Terminated: ok {rc=0} 17:28:57.520047 --- ParallelTerminationStrategy: PID 10723 died... 17:28:57.540242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10723): Terminated: ok {rc=0} 17:28:57.631267 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:28:58.847182 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:58.854323 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:28:58.887995 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:28:58.916806 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:28:58.969583 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:28:59.004295 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:28:59.032759 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:28:59.578967 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:28:59.630195 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:59.641425 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:28:59.709839 tst mo_mt_call.py: using LAC 35135 17:28:59.832872 tst mo_mt_call.py: using RAC 200 17:28:59.953413 tst mo_mt_call.py: using CellId 35135 17:29:00.075274 tst mo_mt_call.py: using BVCI 35136 17:29:00.189381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:00.200451 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:00.211457 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:00.222494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:00.233576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:00.244507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:00.367817 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:00.492567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:01.025699 run create_hlr_db(pid=10729): Launched 17:29:01.173302 bus /sierra_2: Setting Powered False 17:29:02.245570 run create_hlr_db(pid=10729): Terminated: ok {rc=0} 17:29:02.696563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Launched 17:29:03.005368 run osmo-hlr_10.42.42.2(pid=10732): Launched 17:29:03.122045 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:03.667085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Launched 17:29:03.976027 run osmo-stp_10.42.42.5(pid=10735): Launched 17:29:04.093547 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:04.652238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Launched 17:29:04.961219 run osmo-msc_10.42.42.6(pid=10738): Launched 17:29:05.133914 run osmo-stp_10.42.42.5(pid=10735): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] 17:29:05.264532 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-13_17:29:03.918873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:05.394864 run osmo-stp_10.42.42.5(pid=10735): stderr: | [0;m[38;5;43m20221213172904087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172904088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172904088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172904088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:05.523794 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-13_17:29:03.918873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:05.646592 run osmo-stp_10.42.42.5(pid=10735): stderr: | [0;m[38;5;43m20221213172904087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172904088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172904088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172904088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172904089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:05.793104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:29:05.802043 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:29:05.828447 run osmo-hlr_10.42.42.2(pid=10732): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10732)] 17:29:05.877218 run osmo-hlr_10.42.42.2(pid=10732): stdout: | (launched: 2022-12-13_17:29:02.949076) 17:29:05.927419 run osmo-hlr_10.42.42.2(pid=10732): stderr: | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172903125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172903137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172903146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172903147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172903147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:05.997119 run osmo-msc_10.42.42.6(pid=10738): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10738)] 17:29:06.045586 run osmo-msc_10.42.42.6(pid=10738): stdout: | (launched: 2022-12-13_17:29:04.904624) 17:29:06.095609 run osmo-msc_10.42.42.6(pid=10738): stderr: | [0;m[38;5;43m20221213172905175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172905175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa026f61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172905175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172905175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172905175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172905175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172905177 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172905178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172905178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172905178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:06.145950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminating (SIGTERM) 17:29:06.185915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminating (SIGTERM) 17:29:06.225779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Terminating (SIGTERM) 17:29:06.265724 --- ParallelTerminationStrategy: PID 10731 died... 17:29:06.284760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminated: ok {rc=0} 17:29:06.328830 --- ParallelTerminationStrategy: PID 10734 died... 17:29:06.347569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminated: ok {rc=0} 17:29:06.391790 --- ParallelTerminationStrategy: PID 10737 died... 17:29:06.410638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Terminated: ok {rc=0} 17:29:06.495388 bus /sierra_3: Setting Powered False 17:29:07.596104 bus /sierra_3: Setting Powered False 17:29:08.714678 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:29:09.867231 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:09.879859 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:29:09.952056 tst mo_mt_call_osmux.py: using LAC 35136 17:29:10.082954 tst mo_mt_call_osmux.py: using RAC 201 17:29:10.213173 tst mo_mt_call_osmux.py: using CellId 35136 17:29:10.342143 tst mo_mt_call_osmux.py: using BVCI 35137 17:29:10.464402 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:10.476133 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:10.487482 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:10.498817 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:10.510668 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:10.522507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:10.644271 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:10.763652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:11.240746 run create_hlr_db(pid=10740): Launched 17:29:11.366835 bus /sierra_2: Setting Powered False 17:29:12.427363 run create_hlr_db(pid=10740): Terminated: ok {rc=0} 17:29:12.859698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Launched 17:29:13.169329 run osmo-hlr_10.42.42.2(pid=10743): Launched 17:29:13.285755 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:13.831133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Launched 17:29:14.143922 run osmo-stp_10.42.42.5(pid=10746): Launched 17:29:14.262092 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:14.821233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Launched 17:29:15.130498 run osmo-msc_10.42.42.6(pid=10749): Launched 17:29:15.304080 run osmo-stp_10.42.42.5(pid=10746): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] 17:29:15.433960 run osmo-stp_10.42.42.5(pid=10746): stdout: | (launched: 2022-12-13_17:29:14.086612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:15.564746 run osmo-stp_10.42.42.5(pid=10746): stderr: | [0;m[38;5;43m20221213172914252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172914253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172914253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172914253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:15.693470 run osmo-stp_10.42.42.5(pid=10746): stdout: | (launched: 2022-12-13_17:29:14.086612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:15.815867 run osmo-stp_10.42.42.5(pid=10746): stderr: | [0;m[38;5;43m20221213172914252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172914253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172914253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172914253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172914254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:15.965692 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10746): Process ended prematurely: osmo-stp_10.42.42.5(pid=10746) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:29:15.975024 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:29:16.002337 run osmo-hlr_10.42.42.2(pid=10743): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10743)] 17:29:16.051589 run osmo-hlr_10.42.42.2(pid=10743): stdout: | (launched: 2022-12-13_17:29:13.112513) 17:29:16.104516 run osmo-hlr_10.42.42.2(pid=10743): stderr: | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172913286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172913298 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172913306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172913306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172913306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:16.176571 run osmo-msc_10.42.42.6(pid=10749): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10749)] 17:29:16.226103 run osmo-msc_10.42.42.6(pid=10749): stdout: | (launched: 2022-12-13_17:29:15.073733) 17:29:16.277485 run osmo-msc_10.42.42.6(pid=10749): stderr: | [0;m[38;5;43m20221213172915343 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172915343 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38911a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172915344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172915344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172915344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172915344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172915346 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172915346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172915346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172915346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:16.328900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Terminating (SIGTERM) 17:29:16.382525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Terminating (SIGTERM) 17:29:16.439660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Terminating (SIGTERM) 17:29:16.498847 --- ParallelTerminationStrategy: PID 10742 died... 17:29:16.524618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Terminated: ok {rc=0} 17:29:16.587872 --- ParallelTerminationStrategy: PID 10745 died... 17:29:16.607956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Terminated: ok {rc=0} 17:29:16.654170 --- ParallelTerminationStrategy: PID 10748 died... 17:29:16.673811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Terminated: ok {rc=0} 17:29:16.769387 bus /sierra_3: Setting Powered False 17:29:17.866578 bus /sierra_3: Setting Powered False 17:29:18.982862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:29:20.232650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:20.239521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:29:20.272035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:29:20.298686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:29:20.349536 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:29:20.382954 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:29:20.409411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:29:20.960330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:29:21.009775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.020768 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:21.090375 tst mo_mt_call.py: using LAC 35137 17:29:21.211841 tst mo_mt_call.py: using RAC 202 17:29:21.342254 tst mo_mt_call.py: using CellId 35137 17:29:21.472266 tst mo_mt_call.py: using BVCI 35138 17:29:21.594708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.606497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.618081 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.629719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.641740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:21.653358 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:21.773247 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:21.890905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:22.368870 run create_hlr_db(pid=10754): Launched 17:29:22.496342 bus /sierra_2: Setting Powered False 17:29:23.561878 run create_hlr_db(pid=10754): Terminated: ok {rc=0} 17:29:24.021941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Launched 17:29:24.352764 run osmo-hlr_10.42.42.2(pid=10757): Launched 17:29:24.478834 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:25.050975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Launched 17:29:25.383424 run osmo-stp_10.42.42.5(pid=10760): Launched 17:29:25.509113 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:26.107137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Launched 17:29:26.438329 run osmo-msc_10.42.42.6(pid=10763): Launched 17:29:26.623477 run osmo-stp_10.42.42.5(pid=10760): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] 17:29:26.762468 run osmo-stp_10.42.42.5(pid=10760): stdout: | (launched: 2022-12-13_17:29:25.323086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:26.902638 run osmo-stp_10.42.42.5(pid=10760): stderr: | [0;m[38;5;43m20221213172925511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172925511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172925512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172925512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:27.041602 run osmo-stp_10.42.42.5(pid=10760): stdout: | (launched: 2022-12-13_17:29:25.323086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:27.173160 run osmo-stp_10.42.42.5(pid=10760): stderr: | [0;m[38;5;43m20221213172925511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172925511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172925512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172925512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172925513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:27.330052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10760): Process ended prematurely: osmo-stp_10.42.42.5(pid=10760) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:29:27.339787 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:29:27.367925 run osmo-hlr_10.42.42.2(pid=10757): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10757)] 17:29:27.419994 run osmo-hlr_10.42.42.2(pid=10757): stdout: | (launched: 2022-12-13_17:29:24.292467) 17:29:27.473063 run osmo-hlr_10.42.42.2(pid=10757): stderr: | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172924488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172924504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172924513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172924514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172924514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:27.546346 run osmo-msc_10.42.42.6(pid=10763): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10763)] 17:29:27.597295 run osmo-msc_10.42.42.6(pid=10763): stdout: | (launched: 2022-12-13_17:29:26.377961) 17:29:27.649827 run osmo-msc_10.42.42.6(pid=10763): stderr: | [0;m[38;5;43m20221213172926699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172926699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0dff9efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172926699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172926700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172926700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172926700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172926702 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172926702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172926702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172926702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:27.702893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Terminating (SIGTERM) 17:29:27.745420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Terminating (SIGTERM) 17:29:27.788107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Terminating (SIGTERM) 17:29:27.831484 --- ParallelTerminationStrategy: PID 10756 died... 17:29:27.852262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Terminated: ok {rc=0} 17:29:27.899850 --- ParallelTerminationStrategy: PID 10759 died... 17:29:27.920070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Terminated: ok {rc=0} 17:29:27.967286 --- ParallelTerminationStrategy: PID 10762 died... 17:29:27.987553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Terminated: ok {rc=0} 17:29:28.078428 bus /sierra_3: Setting Powered False 17:29:29.180723 bus /sierra_3: Setting Powered False 17:29:30.298756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:29:31.452301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:31.465673 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:31.539903 tst mo_mt_call_osmux.py: using LAC 35138 17:29:31.672033 tst mo_mt_call_osmux.py: using RAC 203 17:29:31.795409 tst mo_mt_call_osmux.py: using CellId 35138 17:29:31.928871 tst mo_mt_call_osmux.py: using BVCI 35139 17:29:32.095921 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:32.108507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:32.128405 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:32.149535 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:32.171105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:32.183030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:32.303170 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:32.426951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:32.909796 run create_hlr_db(pid=10765): Launched 17:29:33.036161 bus /sierra_2: Setting Powered False 17:29:34.098506 run create_hlr_db(pid=10765): Terminated: ok {rc=0} 17:29:34.550932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Launched 17:29:34.882840 run osmo-hlr_10.42.42.2(pid=10768): Launched 17:29:35.010504 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:35.583309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Launched 17:29:35.915376 run osmo-stp_10.42.42.5(pid=10771): Launched 17:29:36.041135 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:36.645153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Launched 17:29:36.976915 run osmo-msc_10.42.42.6(pid=10774): Launched 17:29:37.161311 run osmo-stp_10.42.42.5(pid=10771): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] 17:29:37.300918 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-13_17:29:35.855460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:37.441853 run osmo-stp_10.42.42.5(pid=10771): stderr: | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172936044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:37.580060 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-13_17:29:35.855460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:37.712151 run osmo-stp_10.42.42.5(pid=10771): stderr: | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172936043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172936044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172936044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:37.870608 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:29:37.880288 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:29:37.908511 run osmo-hlr_10.42.42.2(pid=10768): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10768)] 17:29:37.960249 run osmo-hlr_10.42.42.2(pid=10768): stdout: | (launched: 2022-12-13_17:29:34.822519) 17:29:38.013908 run osmo-hlr_10.42.42.2(pid=10768): stderr: | [0;m[1;31m20221213172935016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172935016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172935016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172935017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172935017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172935017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172935028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172935037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172935037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172935037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:38.087885 run osmo-msc_10.42.42.6(pid=10774): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10774)] 17:29:38.139223 run osmo-msc_10.42.42.6(pid=10774): stdout: | (launched: 2022-12-13_17:29:36.916260) 17:29:38.192242 run osmo-msc_10.42.42.6(pid=10774): stderr: | [0;m[38;5;43m20221213172937236 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172937237 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef32b88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172937237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172937237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172937237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172937237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172937239 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172937239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172937239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172937239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:38.245439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminating (SIGTERM) 17:29:38.288060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminating (SIGTERM) 17:29:38.331104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Terminating (SIGTERM) 17:29:38.374401 --- ParallelTerminationStrategy: PID 10767 died... 17:29:38.395221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminated: ok {rc=0} 17:29:38.442452 --- ParallelTerminationStrategy: PID 10770 died... 17:29:38.462624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminated: ok {rc=0} 17:29:38.509682 --- ParallelTerminationStrategy: PID 10773 died... 17:29:38.529813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Terminated: ok {rc=0} 17:29:38.619602 bus /sierra_3: Setting Powered False 17:29:39.719134 bus /sierra_3: Setting Powered False 17:29:40.836577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:29:42.088705 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:42.095963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:29:42.130016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:29:42.158645 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:29:42.210823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:29:42.244747 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:29:42.272325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:29:42.827825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:29:42.883420 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:42.894999 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:42.968306 tst mo_mt_call.py: using LAC 35139 17:29:43.097496 tst mo_mt_call.py: using RAC 204 17:29:43.218413 tst mo_mt_call.py: using CellId 35139 17:29:43.340643 tst mo_mt_call.py: using BVCI 35140 17:29:43.454209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:43.465421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:43.476349 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:43.487347 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:43.498331 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:43.509318 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:43.633772 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:43.756191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:44.269230 run create_hlr_db(pid=10780): Launched 17:29:44.396237 bus /sierra_2: Setting Powered False 17:29:45.461891 run create_hlr_db(pid=10780): Terminated: ok {rc=0} 17:29:45.941946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10782): Launched 17:29:46.287429 run osmo-hlr_10.42.42.2(pid=10783): Launched 17:29:46.546861 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:47.259295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10785): Launched 17:29:47.601582 run osmo-stp_10.42.42.5(pid=10786): Launched 17:29:47.730267 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:48.332126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10788): Launched 17:29:48.663603 run osmo-msc_10.42.42.6(pid=10789): Launched 17:29:48.848265 run osmo-stp_10.42.42.5(pid=10786): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10786)] 17:29:48.988197 run osmo-stp_10.42.42.5(pid=10786): stdout: | (launched: 2022-12-13_17:29:47.541630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:49.129798 run osmo-stp_10.42.42.5(pid=10786): stderr: | [0;m[38;5;43m20221213172947730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172947730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172947731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172947731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:49.269186 run osmo-stp_10.42.42.5(pid=10786): stdout: | (launched: 2022-12-13_17:29:47.541630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:49.401415 run osmo-stp_10.42.42.5(pid=10786): stderr: | [0;m[38;5;43m20221213172947730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172947730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172947731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172947731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172947732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:49.559425 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10786): Process ended prematurely: osmo-stp_10.42.42.5(pid=10786) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10786)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:29:49.569246 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:29:49.597257 run osmo-hlr_10.42.42.2(pid=10783): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10783)] 17:29:49.648718 run osmo-hlr_10.42.42.2(pid=10783): stdout: | (launched: 2022-12-13_17:29:46.225463) 17:29:49.701429 run osmo-hlr_10.42.42.2(pid=10783): stderr: | [0;m[1;31m20221213172946457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172946457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172946457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172946458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172946458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172946458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172946471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172946479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172946480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172946480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:49.774711 run osmo-msc_10.42.42.6(pid=10789): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10789)] 17:29:49.825282 run osmo-msc_10.42.42.6(pid=10789): stdout: | (launched: 2022-12-13_17:29:48.603143) 17:29:49.878093 run osmo-msc_10.42.42.6(pid=10789): stderr: | [0;m[38;5;43m20221213172948921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172948922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b5ca07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172948922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172948922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172948922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172948922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172948924 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172948924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172948924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172948925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:49.930845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10782): Terminating (SIGTERM) 17:29:49.973115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10785): Terminating (SIGTERM) 17:29:50.016482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10788): Terminating (SIGTERM) 17:29:50.059402 --- ParallelTerminationStrategy: PID 10782 died... 17:29:50.079861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10782): Terminated: ok {rc=0} 17:29:50.127505 --- ParallelTerminationStrategy: PID 10785 died... 17:29:50.147584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10785): Terminated: ok {rc=0} 17:29:50.194438 --- ParallelTerminationStrategy: PID 10788 died... 17:29:50.214575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10788): Terminated: ok {rc=0} 17:29:50.305296 bus /sierra_3: Setting Powered False 17:29:51.402392 bus /sierra_3: Setting Powered False 17:29:52.519647 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:29:53.668769 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:53.680545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:53.750556 tst mo_mt_call_osmux.py: using LAC 35140 17:29:53.872258 tst mo_mt_call_osmux.py: using RAC 205 17:29:53.994990 tst mo_mt_call_osmux.py: using CellId 35140 17:29:54.117272 tst mo_mt_call_osmux.py: using BVCI 35141 17:29:54.228832 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:54.239944 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:54.250810 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:54.261930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:54.272764 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:54.283632 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:54.402579 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:54.524792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:55.036579 run create_hlr_db(pid=10791): Launched 17:29:55.162864 bus /sierra_2: Setting Powered False 17:29:56.227926 run create_hlr_db(pid=10791): Terminated: ok {rc=0} 17:29:56.670532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10793): Launched 17:29:56.980075 run osmo-hlr_10.42.42.2(pid=10794): Launched 17:29:57.097977 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:57.643133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10796): Launched 17:29:57.952658 run osmo-stp_10.42.42.5(pid=10797): Launched 17:29:58.069922 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:58.630205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10799): Launched 17:29:58.940636 run osmo-msc_10.42.42.6(pid=10800): Launched 17:29:59.113168 run osmo-stp_10.42.42.5(pid=10797): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10797)] 17:29:59.243839 run osmo-stp_10.42.42.5(pid=10797): stdout: | (launched: 2022-12-13_17:29:57.895585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:59.374793 run osmo-stp_10.42.42.5(pid=10797): stderr: | [0;m[38;5;43m20221213172958065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172958065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172958066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172958066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:59.503377 run osmo-stp_10.42.42.5(pid=10797): stdout: | (launched: 2022-12-13_17:29:57.895585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:59.625901 run osmo-stp_10.42.42.5(pid=10797): stderr: | [0;m[38;5;43m20221213172958065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213172958065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213172958066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213172958066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213172958067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:59.772567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10797): Process ended prematurely: osmo-stp_10.42.42.5(pid=10797) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10797)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:29:59.781667 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:29:59.808122 run osmo-hlr_10.42.42.2(pid=10794): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10794)] 17:29:59.856565 run osmo-hlr_10.42.42.2(pid=10794): stdout: | (launched: 2022-12-13_17:29:56.923641) 17:29:59.906844 run osmo-hlr_10.42.42.2(pid=10794): stderr: | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213172957097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213172957109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213172957117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213172957118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213172957118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:59.977522 run osmo-msc_10.42.42.6(pid=10800): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10800)] 17:30:00.026194 run osmo-msc_10.42.42.6(pid=10800): stdout: | (launched: 2022-12-13_17:29:58.883981) 17:30:00.076195 run osmo-msc_10.42.42.6(pid=10800): stderr: | [0;m[38;5;43m20221213172959156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213172959156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f998aa0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213172959156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213172959156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213172959156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213172959157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213172959158 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213172959159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213172959159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213172959159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:00.126680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10793): Terminating (SIGTERM) 17:30:00.166861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10796): Terminating (SIGTERM) 17:30:00.207018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10799): Terminating (SIGTERM) 17:30:00.247506 --- ParallelTerminationStrategy: PID 10793 died... 17:30:00.266885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10793): Terminated: ok {rc=0} 17:30:00.311407 --- ParallelTerminationStrategy: PID 10796 died... 17:30:00.330287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10796): Terminated: ok {rc=0} 17:30:00.374599 --- ParallelTerminationStrategy: PID 10799 died... 17:30:00.393335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10799): Terminated: ok {rc=0} 17:30:00.480245 bus /sierra_3: Setting Powered False 17:30:01.595987 bus /sierra_3: Setting Powered False 17:30:02.759169 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:30:04.011793 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:04.019419 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:30:04.053618 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:30:04.082232 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:30:04.133214 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:30:04.167730 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:30:04.195587 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:30:04.746666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:30:04.796076 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:04.807221 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:30:04.874240 tst mo_mt_call.py: using LAC 35141 17:30:04.995670 tst mo_mt_call.py: using RAC 206 17:30:05.116364 tst mo_mt_call.py: using CellId 35141 17:30:05.235716 tst mo_mt_call.py: using BVCI 35142 17:30:05.346929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:05.358138 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:05.369045 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:05.379883 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:05.390826 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:05.401775 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:05.523657 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:05.646284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:06.159851 run create_hlr_db(pid=10808): Launched 17:30:06.287953 bus /sierra_2: Setting Powered False 17:30:07.354227 run create_hlr_db(pid=10808): Terminated: ok {rc=0} 17:30:07.797078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Launched 17:30:08.107680 run osmo-hlr_10.42.42.2(pid=10811): Launched 17:30:08.225409 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:08.773342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Launched 17:30:09.081636 run osmo-stp_10.42.42.5(pid=10814): Launched 17:30:09.200431 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:09.766337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Launched 17:30:10.079520 run osmo-msc_10.42.42.6(pid=10817): Launched 17:30:10.252504 run osmo-stp_10.42.42.5(pid=10814): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] 17:30:10.383547 run osmo-stp_10.42.42.5(pid=10814): stdout: | (launched: 2022-12-13_17:30:09.024897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:10.514084 run osmo-stp_10.42.42.5(pid=10814): stderr: | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173009193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173009193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173009193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173009194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:10.642689 run osmo-stp_10.42.42.5(pid=10814): stdout: | (launched: 2022-12-13_17:30:09.024897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:10.765247 run osmo-stp_10.42.42.5(pid=10814): stderr: | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173009192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173009193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173009193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173009193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173009194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:10.912012 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10814): Process ended prematurely: osmo-stp_10.42.42.5(pid=10814) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:30:10.921062 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:30:10.947725 run osmo-hlr_10.42.42.2(pid=10811): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10811)] 17:30:10.996001 run osmo-hlr_10.42.42.2(pid=10811): stdout: | (launched: 2022-12-13_17:30:08.050961) 17:30:11.046052 run osmo-hlr_10.42.42.2(pid=10811): stderr: | [0;m[1;31m20221213173008226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173008226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173008226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173008226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173008226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173008227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173008239 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:11.116010 run osmo-msc_10.42.42.6(pid=10817): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10817)] 17:30:11.164394 run osmo-msc_10.42.42.6(pid=10817): stdout: | (launched: 2022-12-13_17:30:10.022607) 17:30:11.214421 run osmo-msc_10.42.42.6(pid=10817): stderr: | [0;m[38;5;43m20221213173010294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173010294 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b7ba07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173010294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173010294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173010295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173010295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173010296 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173010297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173010297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173010297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:11.264818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Terminating (SIGTERM) 17:30:11.304831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Terminating (SIGTERM) 17:30:11.344933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Terminating (SIGTERM) 17:30:11.385313 --- ParallelTerminationStrategy: PID 10810 died... 17:30:11.404578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Terminated: ok {rc=0} 17:30:11.448877 --- ParallelTerminationStrategy: PID 10813 died... 17:30:11.468096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Terminated: ok {rc=0} 17:30:11.512429 --- ParallelTerminationStrategy: PID 10816 died... 17:30:11.531322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Terminated: ok {rc=0} 17:30:11.616249 bus /sierra_3: Setting Powered False 17:30:12.714353 bus /sierra_3: Setting Powered False 17:30:13.835384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:30:14.984465 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:14.996206 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:30:15.066085 tst mo_mt_call_osmux.py: using LAC 35142 17:30:15.196709 tst mo_mt_call_osmux.py: using RAC 207 17:30:15.328667 tst mo_mt_call_osmux.py: using CellId 35142 17:30:15.458429 tst mo_mt_call_osmux.py: using BVCI 35143 17:30:15.579249 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:15.590847 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:15.602282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:15.613665 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:15.625448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:15.637161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:15.758382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:15.895302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:16.426433 run create_hlr_db(pid=10819): Launched 17:30:16.589590 bus /sierra_2: Setting Powered False 17:30:17.654505 run create_hlr_db(pid=10819): Terminated: ok {rc=0} 17:30:18.099893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Launched 17:30:18.430754 run osmo-hlr_10.42.42.2(pid=10822): Launched 17:30:18.557740 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:19.132225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Launched 17:30:19.463546 run osmo-stp_10.42.42.5(pid=10825): Launched 17:30:19.590930 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:20.188876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Launched 17:30:20.519594 run osmo-msc_10.42.42.6(pid=10828): Launched 17:30:20.703315 run osmo-stp_10.42.42.5(pid=10825): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] 17:30:20.842734 run osmo-stp_10.42.42.5(pid=10825): stdout: | (launched: 2022-12-13_17:30:19.403514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:20.983246 run osmo-stp_10.42.42.5(pid=10825): stderr: | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173019594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:21.122051 run osmo-stp_10.42.42.5(pid=10825): stdout: | (launched: 2022-12-13_17:30:19.403514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:21.253593 run osmo-stp_10.42.42.5(pid=10825): stderr: | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173019594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173019594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173019595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:21.411507 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10825): Process ended prematurely: osmo-stp_10.42.42.5(pid=10825) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:30:21.421160 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:30:21.449305 run osmo-hlr_10.42.42.2(pid=10822): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10822)] 17:30:21.501207 run osmo-hlr_10.42.42.2(pid=10822): stdout: | (launched: 2022-12-13_17:30:18.371008) 17:30:21.554813 run osmo-hlr_10.42.42.2(pid=10822): stderr: | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173018566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173018580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173018590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173018590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173018590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:21.629196 run osmo-msc_10.42.42.6(pid=10828): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10828)] 17:30:21.680385 run osmo-msc_10.42.42.6(pid=10828): stdout: | (launched: 2022-12-13_17:30:20.459294) 17:30:21.734107 run osmo-msc_10.42.42.6(pid=10828): stderr: | [0;m[38;5;43m20221213173020778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173020778 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f093be15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173020779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173020779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173020779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173020779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173020781 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173020781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173020781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173020781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:21.787823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Terminating (SIGTERM) 17:30:21.830684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Terminating (SIGTERM) 17:30:21.873933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Terminating (SIGTERM) 17:30:21.917543 --- ParallelTerminationStrategy: PID 10821 died... 17:30:21.938438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Terminated: ok {rc=0} 17:30:21.986147 --- ParallelTerminationStrategy: PID 10824 died... 17:30:22.006569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Terminated: ok {rc=0} 17:30:22.054457 --- ParallelTerminationStrategy: PID 10827 died... 17:30:22.074898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Terminated: ok {rc=0} 17:30:22.166670 bus /sierra_3: Setting Powered False 17:30:23.267938 bus /sierra_3: Setting Powered False 17:30:24.387639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:30:25.642911 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:25.649402 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:30:25.682235 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:30:25.709059 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:30:25.760170 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:30:25.793729 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:30:25.820262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:30:26.370802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:30:26.419900 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:26.430974 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:26.500129 tst mo_mt_call.py: using LAC 35143 17:30:26.623946 tst mo_mt_call.py: using RAC 208 17:30:26.746904 tst mo_mt_call.py: using CellId 35143 17:30:26.869454 tst mo_mt_call.py: using BVCI 35144 17:30:26.983026 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:26.994168 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:27.005031 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:27.015846 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:27.026803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:27.037762 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:27.156810 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:27.278813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:27.790313 run create_hlr_db(pid=10833): Launched 17:30:27.916938 bus /sierra_2: Setting Powered False 17:30:28.982477 run create_hlr_db(pid=10833): Terminated: ok {rc=0} 17:30:29.444504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Launched 17:30:29.774609 run osmo-hlr_10.42.42.2(pid=10836): Launched 17:30:29.900402 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:30.471085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Launched 17:30:30.803733 run osmo-stp_10.42.42.5(pid=10839): Launched 17:30:31.045112 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:31.707881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Launched 17:30:32.062475 run osmo-msc_10.42.42.6(pid=10842): Launched 17:30:32.380553 run osmo-stp_10.42.42.5(pid=10839): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] 17:30:32.514571 run osmo-stp_10.42.42.5(pid=10839): stdout: | (launched: 2022-12-13_17:30:30.743326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:32.646534 run osmo-stp_10.42.42.5(pid=10839): stderr: | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173030984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:32.775951 run osmo-stp_10.42.42.5(pid=10839): stdout: | (launched: 2022-12-13_17:30:30.743326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:32.899567 run osmo-stp_10.42.42.5(pid=10839): stderr: | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173030984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173030984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173030989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:33.046664 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10839): Process ended prematurely: osmo-stp_10.42.42.5(pid=10839) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:30:33.055693 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:30:33.082799 run osmo-hlr_10.42.42.2(pid=10836): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10836)] 17:30:33.131510 run osmo-hlr_10.42.42.2(pid=10836): stdout: | (launched: 2022-12-13_17:30:29.714975) 17:30:33.182068 run osmo-hlr_10.42.42.2(pid=10836): stderr: | [0;m[1;31m20221213173029908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173029908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173029908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173029908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173029908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173029909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173029920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173029929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173029929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173029929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:33.252447 run osmo-msc_10.42.42.6(pid=10842): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10842)] 17:30:33.301162 run osmo-msc_10.42.42.6(pid=10842): stdout: | (launched: 2022-12-13_17:30:31.997203) 17:30:33.351701 run osmo-msc_10.42.42.6(pid=10842): stderr: | [0;m[38;5;43m20221213173032415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173032415 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ea7168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173032416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173032416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173032416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173032416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173032418 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173032418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173032418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173032418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:33.402402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Terminating (SIGTERM) 17:30:33.442886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Terminating (SIGTERM) 17:30:33.483319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Terminating (SIGTERM) 17:30:33.523915 --- ParallelTerminationStrategy: PID 10835 died... 17:30:33.543436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Terminated: ok {rc=0} 17:30:33.588685 --- ParallelTerminationStrategy: PID 10838 died... 17:30:33.607734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Terminated: ok {rc=0} 17:30:33.652930 --- ParallelTerminationStrategy: PID 10841 died... 17:30:33.672517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Terminated: ok {rc=0} 17:30:33.760271 bus /sierra_3: Setting Powered False 17:30:34.862356 bus /sierra_3: Setting Powered False 17:30:35.978229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:30:37.130862 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.143203 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:37.215932 tst mo_mt_call_osmux.py: using LAC 35144 17:30:37.346862 tst mo_mt_call_osmux.py: using RAC 209 17:30:37.476528 tst mo_mt_call_osmux.py: using CellId 35144 17:30:37.606226 tst mo_mt_call_osmux.py: using BVCI 35145 17:30:37.726927 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.738666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.750130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.761677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.773512 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:37.785379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:37.908709 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:38.028608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:38.509225 run create_hlr_db(pid=10844): Launched 17:30:38.635427 bus /sierra_2: Setting Powered False 17:30:39.697363 run create_hlr_db(pid=10844): Terminated: ok {rc=0} 17:30:40.130915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Launched 17:30:40.441710 run osmo-hlr_10.42.42.2(pid=10847): Launched 17:30:40.558847 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:41.109786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Launched 17:30:41.419621 run osmo-stp_10.42.42.5(pid=10850): Launched 17:30:41.538622 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:42.100495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Launched 17:30:42.411724 run osmo-msc_10.42.42.6(pid=10853): Launched 17:30:42.584186 run osmo-stp_10.42.42.5(pid=10850): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] 17:30:42.715386 run osmo-stp_10.42.42.5(pid=10850): stdout: | (launched: 2022-12-13_17:30:41.362232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:42.846303 run osmo-stp_10.42.42.5(pid=10850): stderr: | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173041534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173041534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173041535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173041535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:42.975495 run osmo-stp_10.42.42.5(pid=10850): stdout: | (launched: 2022-12-13_17:30:41.362232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:43.098520 run osmo-stp_10.42.42.5(pid=10850): stderr: | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173041532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173041534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173041534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173041535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173041535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:43.245796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10850): Process ended prematurely: osmo-stp_10.42.42.5(pid=10850) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:30:43.254684 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:30:43.281468 run osmo-hlr_10.42.42.2(pid=10847): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10847)] 17:30:43.330138 run osmo-hlr_10.42.42.2(pid=10847): stdout: | (launched: 2022-12-13_17:30:40.385170) 17:30:43.380520 run osmo-hlr_10.42.42.2(pid=10847): stderr: | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173040558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173040570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173040579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173040579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173040579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:43.450946 run osmo-msc_10.42.42.6(pid=10853): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10853)] 17:30:43.499472 run osmo-msc_10.42.42.6(pid=10853): stdout: | (launched: 2022-12-13_17:30:42.354282) 17:30:43.549835 run osmo-msc_10.42.42.6(pid=10853): stderr: | [0;m[38;5;43m20221213173042624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173042624 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff776f7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173042624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173042625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173042625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173042625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173042627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173042627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173042627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173042627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:43.600567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Terminating (SIGTERM) 17:30:43.641098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Terminating (SIGTERM) 17:30:43.681542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Terminating (SIGTERM) 17:30:43.722188 --- ParallelTerminationStrategy: PID 10846 died... 17:30:43.741640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Terminated: ok {rc=0} 17:30:43.786268 --- ParallelTerminationStrategy: PID 10849 died... 17:30:43.805261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Terminated: ok {rc=0} 17:30:43.849835 --- ParallelTerminationStrategy: PID 10852 died... 17:30:43.868698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Terminated: ok {rc=0} 17:30:43.953948 bus /sierra_3: Setting Powered False 17:30:45.054280 bus /sierra_3: Setting Powered False 17:30:46.172586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:30:47.427772 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:47.434939 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:30:47.469753 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:30:47.498070 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:30:47.551724 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:30:47.587167 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:30:47.615104 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:30:48.169777 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:30:48.223331 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.235133 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:48.306244 tst mo_mt_call.py: using LAC 35145 17:30:48.438357 tst mo_mt_call.py: using RAC 210 17:30:48.569322 tst mo_mt_call.py: using CellId 35145 17:30:48.700009 tst mo_mt_call.py: using BVCI 35146 17:30:48.820858 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.832668 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.844328 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.856033 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.868086 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:48.880563 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:49.001582 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:49.124156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:49.637162 run create_hlr_db(pid=10858): Launched 17:30:49.762396 bus /sierra_2: Setting Powered False 17:30:50.827993 run create_hlr_db(pid=10858): Terminated: ok {rc=0} 17:30:51.288787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Launched 17:30:51.619343 run osmo-hlr_10.42.42.2(pid=10861): Launched 17:30:51.745356 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:52.299829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Launched 17:30:52.611310 run osmo-stp_10.42.42.5(pid=10864): Launched 17:30:52.728461 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:53.289463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Launched 17:30:53.599836 run osmo-msc_10.42.42.6(pid=10867): Launched 17:30:53.771822 run osmo-stp_10.42.42.5(pid=10864): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] 17:30:53.902128 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_17:30:52.553653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:54.032228 run osmo-stp_10.42.42.5(pid=10864): stderr: | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173052722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:54.160846 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_17:30:52.553653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:54.283284 run osmo-stp_10.42.42.5(pid=10864): stderr: | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173052722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173052722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173052723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:54.430309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:30:54.439240 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:30:54.465503 run osmo-hlr_10.42.42.2(pid=10861): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10861)] 17:30:54.513437 run osmo-hlr_10.42.42.2(pid=10861): stdout: | (launched: 2022-12-13_17:30:51.559108) 17:30:54.563168 run osmo-hlr_10.42.42.2(pid=10861): stderr: | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173051755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173051767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173051775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173051776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173051776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:54.632861 run osmo-msc_10.42.42.6(pid=10867): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10867)] 17:30:54.681358 run osmo-msc_10.42.42.6(pid=10867): stdout: | (launched: 2022-12-13_17:30:53.543151) 17:30:54.731262 run osmo-msc_10.42.42.6(pid=10867): stderr: | [0;m[38;5;43m20221213173053813 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173053813 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff5ca2e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173053813 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173053814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173053814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173053814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173053816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173053816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173053816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173053816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:54.781516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminating (SIGTERM) 17:30:54.821583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminating (SIGTERM) 17:30:54.861670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminating (SIGTERM) 17:30:54.901910 --- ParallelTerminationStrategy: PID 10860 died... 17:30:54.921095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminated: ok {rc=0} 17:30:54.965592 --- ParallelTerminationStrategy: PID 10863 died... 17:30:54.984205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminated: ok {rc=0} 17:30:55.028376 --- ParallelTerminationStrategy: PID 10866 died... 17:30:55.047151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminated: ok {rc=0} 17:30:55.134021 bus /sierra_3: Setting Powered False 17:30:56.233995 bus /sierra_3: Setting Powered False 17:30:57.349951 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:30:58.498412 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:58.510390 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:58.581083 tst mo_mt_call_osmux.py: using LAC 35146 17:30:58.704207 tst mo_mt_call_osmux.py: using RAC 211 17:30:58.835694 tst mo_mt_call_osmux.py: using CellId 35146 17:30:58.971556 tst mo_mt_call_osmux.py: using BVCI 35147 17:30:59.093767 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:59.105711 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:59.117492 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:59.129135 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:59.141241 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:59.153082 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:59.277729 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:59.403007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:59.916741 run create_hlr_db(pid=10869): Launched 17:31:00.043560 bus /sierra_2: Setting Powered False 17:31:01.109839 run create_hlr_db(pid=10869): Terminated: ok {rc=0} 17:31:01.561933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10871): Launched 17:31:01.896573 run osmo-hlr_10.42.42.2(pid=10872): Launched 17:31:02.142246 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:02.731965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10874): Launched 17:31:03.043240 run osmo-stp_10.42.42.5(pid=10875): Launched 17:31:03.160529 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:03.722499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10877): Launched 17:31:04.035611 run osmo-msc_10.42.42.6(pid=10878): Launched 17:31:04.208145 run osmo-stp_10.42.42.5(pid=10875): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10875)] 17:31:04.339176 run osmo-stp_10.42.42.5(pid=10875): stdout: | (launched: 2022-12-13_17:31:02.986080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:04.471124 run osmo-stp_10.42.42.5(pid=10875): stderr: | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173103157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:04.600169 run osmo-stp_10.42.42.5(pid=10875): stdout: | (launched: 2022-12-13_17:31:02.986080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:04.723275 run osmo-stp_10.42.42.5(pid=10875): stderr: | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173103156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173103157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173103157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:04.870494 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10875): Process ended prematurely: osmo-stp_10.42.42.5(pid=10875) [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10875)] [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:31:04.879740 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:31:04.906294 run osmo-hlr_10.42.42.2(pid=10872): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10872)] 17:31:04.954627 run osmo-hlr_10.42.42.2(pid=10872): stdout: | (launched: 2022-12-13_17:31:01.836721) 17:31:05.004657 run osmo-hlr_10.42.42.2(pid=10872): stderr: | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173102178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173102194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173102206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173102206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173102206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:05.075132 run osmo-msc_10.42.42.6(pid=10878): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10878)] 17:31:05.123525 run osmo-msc_10.42.42.6(pid=10878): stdout: | (launched: 2022-12-13_17:31:03.978569) 17:31:05.173824 run osmo-msc_10.42.42.6(pid=10878): stderr: | [0;m[38;5;43m20221213173104247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173104248 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f05970c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173104248 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173104248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173104248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173104248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173104250 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173104250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173104251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173104251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:05.224589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10871): Terminating (SIGTERM) 17:31:05.264921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10874): Terminating (SIGTERM) 17:31:05.305436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10877): Terminating (SIGTERM) 17:31:05.345872 --- ParallelTerminationStrategy: PID 10871 died... 17:31:05.365217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10871): Terminated: ok {rc=0} 17:31:05.409525 --- ParallelTerminationStrategy: PID 10874 died... 17:31:05.428260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10874): Terminated: ok {rc=0} 17:31:05.472674 --- ParallelTerminationStrategy: PID 10877 died... 17:31:05.491456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10877): Terminated: ok {rc=0} 17:31:05.575996 bus /sierra_3: Setting Powered False 17:31:06.675636 bus /sierra_3: Setting Powered False 17:31:07.794765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:31:09.050576 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:09.057143 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:31:09.092209 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:31:09.120372 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:31:09.172759 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:31:09.207132 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:31:09.234912 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:31:09.785861 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:31:09.839926 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:09.851488 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:09.927038 tst mo_mt_call.py: using LAC 35147 17:31:10.056762 tst mo_mt_call.py: using RAC 212 17:31:10.186870 tst mo_mt_call.py: using CellId 35147 17:31:10.314432 tst mo_mt_call.py: using BVCI 35148 17:31:10.435387 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.447081 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.458476 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.469894 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.481640 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:10.493506 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:10.615505 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:10.734328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:11.213072 run create_hlr_db(pid=10883): Launched 17:31:11.339442 bus /sierra_2: Setting Powered False 17:31:12.402126 run create_hlr_db(pid=10883): Terminated: ok {rc=0} 17:31:12.855236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Launched 17:31:13.188398 run osmo-hlr_10.42.42.2(pid=10886): Launched 17:31:13.314358 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:13.884155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Launched 17:31:14.217184 run osmo-stp_10.42.42.5(pid=10889): Launched 17:31:14.342894 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:14.941761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10891): Launched 17:31:15.275950 run osmo-msc_10.42.42.6(pid=10892): Launched 17:31:15.463389 run osmo-stp_10.42.42.5(pid=10889): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] 17:31:15.608030 run osmo-stp_10.42.42.5(pid=10889): stdout: | (launched: 2022-12-13_17:31:14.156193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:15.749837 run osmo-stp_10.42.42.5(pid=10889): stderr: | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173114347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:15.919415 run osmo-stp_10.42.42.5(pid=10889): stdout: | (launched: 2022-12-13_17:31:14.156193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:16.052624 run osmo-stp_10.42.42.5(pid=10889): stderr: | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173114347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173114347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173114348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:16.208607 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10889): Process ended prematurely: osmo-stp_10.42.42.5(pid=10889) [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:31:16.218811 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:31:16.246899 run osmo-hlr_10.42.42.2(pid=10886): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10886)] 17:31:16.299357 run osmo-hlr_10.42.42.2(pid=10886): stdout: | (launched: 2022-12-13_17:31:13.127918) 17:31:16.351179 run osmo-hlr_10.42.42.2(pid=10886): stderr: | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173113325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173113337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173113347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173113347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173113347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:16.422936 run osmo-msc_10.42.42.6(pid=10892): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10892)] 17:31:16.474007 run osmo-msc_10.42.42.6(pid=10892): stdout: | (launched: 2022-12-13_17:31:15.215148) 17:31:16.525769 run osmo-msc_10.42.42.6(pid=10892): stderr: | [0;m[38;5;43m20221213173115532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173115532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5131959c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173115532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173115532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173115533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173115533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173115535 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173115535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173115535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173115535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:16.577886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Terminating (SIGTERM) 17:31:16.620105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Terminating (SIGTERM) 17:31:16.664893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10891): Terminating (SIGTERM) 17:31:16.711333 --- ParallelTerminationStrategy: PID 10885 died... 17:31:16.731915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Terminated: ok {rc=0} 17:31:16.779061 --- ParallelTerminationStrategy: PID 10888 died... 17:31:16.799382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Terminated: ok {rc=0} 17:31:16.846285 --- ParallelTerminationStrategy: PID 10891 died... 17:31:16.866961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10891): Terminated: ok {rc=0} 17:31:16.962022 bus /sierra_3: Setting Powered False 17:31:18.070621 bus /sierra_3: Setting Powered False 17:31:19.185849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:31:20.334860 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.346565 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:20.417872 tst mo_mt_call_osmux.py: using LAC 35148 17:31:20.540834 tst mo_mt_call_osmux.py: using RAC 213 17:31:20.663053 tst mo_mt_call_osmux.py: using CellId 35148 17:31:20.794579 tst mo_mt_call_osmux.py: using BVCI 35149 17:31:20.917795 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.929256 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.940477 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.951720 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.963390 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:20.975101 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:21.095615 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:21.218448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:21.733725 run create_hlr_db(pid=10894): Launched 17:31:21.862045 bus /sierra_2: Setting Powered False 17:31:22.927702 run create_hlr_db(pid=10894): Terminated: ok {rc=0} 17:31:23.373453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10897): Launched 17:31:23.685789 run osmo-hlr_10.42.42.2(pid=10898): Launched 17:31:23.802923 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:24.337968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10900): Launched 17:31:24.650152 run osmo-stp_10.42.42.5(pid=10901): Launched 17:31:24.769561 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:25.331426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10903): Launched 17:31:25.643678 run osmo-msc_10.42.42.6(pid=10904): Launched 17:31:25.817350 run osmo-stp_10.42.42.5(pid=10901): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10901)] 17:31:25.948199 run osmo-stp_10.42.42.5(pid=10901): stdout: | (launched: 2022-12-13_17:31:24.592445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:26.080352 run osmo-stp_10.42.42.5(pid=10901): stderr: | [0;m[38;5;43m20221213173124762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173124762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173124763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173124763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:26.210092 run osmo-stp_10.42.42.5(pid=10901): stdout: | (launched: 2022-12-13_17:31:24.592445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:26.333271 run osmo-stp_10.42.42.5(pid=10901): stderr: | [0;m[38;5;43m20221213173124762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173124762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173124763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173124763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:26.480686 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10901): Process ended prematurely: osmo-stp_10.42.42.5(pid=10901) [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10901)] [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:31:26.489835 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:31:26.516619 run osmo-hlr_10.42.42.2(pid=10898): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10898)] 17:31:26.565319 run osmo-hlr_10.42.42.2(pid=10898): stdout: | (launched: 2022-12-13_17:31:23.628635) 17:31:26.616173 run osmo-hlr_10.42.42.2(pid=10898): stderr: | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173123803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173123835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173123844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173123845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173123845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:26.686606 run osmo-msc_10.42.42.6(pid=10904): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10904)] 17:31:26.735128 run osmo-msc_10.42.42.6(pid=10904): stdout: | (launched: 2022-12-13_17:31:25.586331) 17:31:26.785443 run osmo-msc_10.42.42.6(pid=10904): stderr: | [0;m[38;5;43m20221213173125858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173125858 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f014566dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173125858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173125858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173125858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173125859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173125860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173125861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173125861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173125861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:26.836082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10897): Terminating (SIGTERM) 17:31:26.876567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10900): Terminating (SIGTERM) 17:31:26.916916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10903): Terminating (SIGTERM) 17:31:26.957775 --- ParallelTerminationStrategy: PID 10897 died... 17:31:26.977351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10897): Terminated: ok {rc=0} 17:31:27.022038 --- ParallelTerminationStrategy: PID 10900 died... 17:31:27.040809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10900): Terminated: ok {rc=0} 17:31:27.085901 --- ParallelTerminationStrategy: PID 10903 died... 17:31:27.105074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10903): Terminated: ok {rc=0} 17:31:27.193059 bus /sierra_3: Setting Powered False 17:31:28.295591 bus /sierra_3: Setting Powered False 17:31:29.414227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 17:31:30.668729 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:30.674554 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 17:31:30.708435 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 17:31:30.737813 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 17:31:30.789102 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 17:31:30.823360 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 17:31:30.878299 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 17:31:31.399584 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 17:31:31.453524 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:31.465537 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:31.518320 tst mo_mt_call.py: using LAC 35149 17:31:31.672894 tst mo_mt_call.py: using RAC 214 17:31:31.819186 tst mo_mt_call.py: using CellId 35149 17:31:31.962519 tst mo_mt_call.py: using BVCI 35150 17:31:32.112932 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.128255 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.141517 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.153558 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.166146 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:32.179372 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:32.305538 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:32.427049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:32.939733 run create_hlr_db(pid=10922): Launched 17:31:33.066687 bus /sierra_2: Setting Powered False 17:31:34.132697 run create_hlr_db(pid=10922): Terminated: ok {rc=0} 17:31:34.575926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10924): Launched 17:31:34.888343 run osmo-hlr_10.42.42.2(pid=10925): Launched 17:31:35.006701 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:35.552056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10927): Launched 17:31:35.864639 run osmo-stp_10.42.42.5(pid=10928): Launched 17:31:35.982851 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:36.542898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10930): Launched 17:31:36.855054 run osmo-msc_10.42.42.6(pid=10931): Launched 17:31:37.027391 run osmo-stp_10.42.42.5(pid=10928): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10928)] 17:31:37.157376 run osmo-stp_10.42.42.5(pid=10928): stdout: | (launched: 2022-12-13_17:31:35.807763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:37.287703 run osmo-stp_10.42.42.5(pid=10928): stderr: | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173135978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:37.416315 run osmo-stp_10.42.42.5(pid=10928): stdout: | (launched: 2022-12-13_17:31:35.807763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:37.539268 run osmo-stp_10.42.42.5(pid=10928): stderr: | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173135977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173135978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:37.686462 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10928): Process ended prematurely: osmo-stp_10.42.42.5(pid=10928) [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10928)] [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 17:31:37.695426 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:31:37.721785 run osmo-hlr_10.42.42.2(pid=10925): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10925)] 17:31:37.770426 run osmo-hlr_10.42.42.2(pid=10925): stdout: | (launched: 2022-12-13_17:31:34.831829) 17:31:37.820187 run osmo-hlr_10.42.42.2(pid=10925): stderr: | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173135005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173135017 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173135026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173135026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173135026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:37.889955 run osmo-msc_10.42.42.6(pid=10931): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10931)] 17:31:37.938255 run osmo-msc_10.42.42.6(pid=10931): stdout: | (launched: 2022-12-13_17:31:36.798142) 17:31:37.988086 run osmo-msc_10.42.42.6(pid=10931): stderr: | [0;m[38;5;43m20221213173137068 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173137069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f654f92cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173137069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173137069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173137069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173137069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173137071 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173137071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173137072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173137072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:38.038353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10924): Terminating (SIGTERM) 17:31:38.078424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10927): Terminating (SIGTERM) 17:31:38.118907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10930): Terminating (SIGTERM) 17:31:38.159504 --- ParallelTerminationStrategy: PID 10924 died... 17:31:38.178894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10924): Terminated: ok {rc=0} 17:31:38.223751 --- ParallelTerminationStrategy: PID 10927 died... 17:31:38.242585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10927): Terminated: ok {rc=0} 17:31:38.286990 --- ParallelTerminationStrategy: PID 10930 died... 17:31:38.305909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10930): Terminated: ok {rc=0} 17:31:38.390432 bus /sierra_3: Setting Powered False 17:31:39.488028 bus /sierra_3: Setting Powered False 17:31:40.605635 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 17:31:41.754855 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:41.766567 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:41.817413 tst mo_mt_call_osmux.py: using LAC 35150 17:31:41.939964 tst mo_mt_call_osmux.py: using RAC 215 17:31:42.062598 tst mo_mt_call_osmux.py: using CellId 35150 17:31:42.185940 tst mo_mt_call_osmux.py: using BVCI 35151 17:31:42.297830 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:42.308858 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:42.319726 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:42.330507 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:42.341287 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:42.352082 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:42.472774 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:42.592143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:43.074067 run create_hlr_db(pid=10933): Launched 17:31:43.203440 bus /sierra_2: Setting Powered False 17:31:44.264900 run create_hlr_db(pid=10933): Terminated: ok {rc=0} 17:31:44.721147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10935): Launched 17:31:45.053313 run osmo-hlr_10.42.42.2(pid=10936): Launched 17:31:45.181664 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:45.754252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10938): Launched 17:31:46.105704 run osmo-stp_10.42.42.5(pid=10939): Launched 17:31:46.344863 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:47.070791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10941): Launched 17:31:47.428381 run osmo-msc_10.42.42.6(pid=10942): Launched 17:31:47.615643 run osmo-stp_10.42.42.5(pid=10939): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10939)] 17:31:47.756105 run osmo-stp_10.42.42.5(pid=10939): stdout: | (launched: 2022-12-13_17:31:46.039259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:47.897374 run osmo-stp_10.42.42.5(pid=10939): stderr: | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173146367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:48.035639 run osmo-stp_10.42.42.5(pid=10939): stdout: | (launched: 2022-12-13_17:31:46.039259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:48.168272 run osmo-stp_10.42.42.5(pid=10939): stderr: | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173146366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173146367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173146367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:48.326475 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10939): Process ended prematurely: osmo-stp_10.42.42.5(pid=10939) [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10939)] [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 17:31:48.336037 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:31:48.364196 run osmo-hlr_10.42.42.2(pid=10936): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10936)] 17:31:48.415899 run osmo-hlr_10.42.42.2(pid=10936): stdout: | (launched: 2022-12-13_17:31:44.992832) 17:31:48.469158 run osmo-hlr_10.42.42.2(pid=10936): stderr: | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173145188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173145203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173145214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173145214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173145214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:48.543120 run osmo-msc_10.42.42.6(pid=10942): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10942)] 17:31:48.593881 run osmo-msc_10.42.42.6(pid=10942): stdout: | (launched: 2022-12-13_17:31:47.367979) 17:31:48.647090 run osmo-msc_10.42.42.6(pid=10942): stderr: | [0;m[38;5;43m20221213173147688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173147688 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe577086c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173147688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173147689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173147689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173147689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173147691 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173147691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173147691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173147691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:48.700499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10935): Terminating (SIGTERM) 17:31:48.742903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10938): Terminating (SIGTERM) 17:31:48.786079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10941): Terminating (SIGTERM) 17:31:48.829153 --- ParallelTerminationStrategy: PID 10935 died... 17:31:48.849736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10935): Terminated: ok {rc=0} 17:31:48.897156 --- ParallelTerminationStrategy: PID 10938 died... 17:31:48.917318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10938): Terminated: ok {rc=0} 17:31:48.964359 --- ParallelTerminationStrategy: PID 10941 died... 17:31:48.984557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10941): Terminated: ok {rc=0} 17:31:49.075038 bus /sierra_3: Setting Powered False 17:31:50.175415 bus /sierra_3: Setting Powered False 17:31:51.294819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:31:52.549432 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:52.555469 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:31:52.588273 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:31:52.614882 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:31:52.664458 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:31:52.697494 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:31:52.724013 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:31:53.278903 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:31:53.328654 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.340175 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:31:53.390886 tst mo_mt_call.py: using LAC 35151 17:31:53.518869 tst mo_mt_call.py: using RAC 216 17:31:53.646885 tst mo_mt_call.py: using CellId 35151 17:31:53.774189 tst mo_mt_call.py: using BVCI 35152 17:31:53.895884 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.907688 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.919236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.930943 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.942977 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:53.954976 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:54.073924 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:54.197535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:54.680295 run create_hlr_db(pid=10947): Launched 17:31:54.810582 bus /sierra_2: Setting Powered False 17:31:55.872482 run create_hlr_db(pid=10947): Terminated: ok {rc=0} 17:31:56.327186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10949): Launched 17:31:56.662700 run osmo-hlr_10.42.42.2(pid=10950): Launched 17:31:56.790807 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:57.362942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10952): Launched 17:31:57.675277 run osmo-stp_10.42.42.5(pid=10953): Launched 17:31:57.793186 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:58.354146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10955): Launched 17:31:58.665411 run osmo-msc_10.42.42.6(pid=10956): Launched 17:31:58.839090 run osmo-stp_10.42.42.5(pid=10953): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10953)] 17:31:58.971290 run osmo-stp_10.42.42.5(pid=10953): stdout: | (launched: 2022-12-13_17:31:57.618387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:59.102807 run osmo-stp_10.42.42.5(pid=10953): stderr: | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173157787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:59.232535 run osmo-stp_10.42.42.5(pid=10953): stdout: | (launched: 2022-12-13_17:31:57.618387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:59.355885 run osmo-stp_10.42.42.5(pid=10953): stderr: | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173157786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173157787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173157787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:59.503774 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10953): Process ended prematurely: osmo-stp_10.42.42.5(pid=10953) [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10953)] [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:31:59.513358 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:31:59.540049 run osmo-hlr_10.42.42.2(pid=10950): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10950)] 17:31:59.588761 run osmo-hlr_10.42.42.2(pid=10950): stdout: | (launched: 2022-12-13_17:31:56.602422) 17:31:59.639366 run osmo-hlr_10.42.42.2(pid=10950): stderr: | [0;m[1;31m20221213173156797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173156797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173156797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173156797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173156798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173156798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173156810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173156818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173156819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173156819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:59.709840 run osmo-msc_10.42.42.6(pid=10956): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10956)] 17:31:59.758484 run osmo-msc_10.42.42.6(pid=10956): stdout: | (launched: 2022-12-13_17:31:58.608224) 17:31:59.808845 run osmo-msc_10.42.42.6(pid=10956): stderr: | [0;m[38;5;43m20221213173158879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173158879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff01d2d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173158879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173158879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173158880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173158880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173158882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173158882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173158882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173158882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:59.859496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10949): Terminating (SIGTERM) 17:31:59.900040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10952): Terminating (SIGTERM) 17:31:59.940393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10955): Terminating (SIGTERM) 17:31:59.981354 --- ParallelTerminationStrategy: PID 10949 died... 17:32:00.001074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10949): Terminated: ok {rc=0} 17:32:00.045967 --- ParallelTerminationStrategy: PID 10952 died... 17:32:00.064900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10952): Terminated: ok {rc=0} 17:32:00.110092 --- ParallelTerminationStrategy: PID 10955 died... 17:32:00.129154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10955): Terminated: ok {rc=0} 17:32:00.216543 bus /sierra_3: Setting Powered False 17:32:01.317315 bus /sierra_3: Setting Powered False 17:32:02.433891 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:32:03.581588 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:03.593757 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:32:03.651480 tst mo_mt_call_osmux.py: using LAC 35152 17:32:03.772794 tst mo_mt_call_osmux.py: using RAC 217 17:32:03.893855 tst mo_mt_call_osmux.py: using CellId 35152 17:32:04.016009 tst mo_mt_call_osmux.py: using BVCI 35153 17:32:04.129150 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:04.140607 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:04.151999 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:04.163329 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:04.174872 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:32:04.186221 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:32:04.304803 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:32:04.432605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:04.947525 run create_hlr_db(pid=10958): Launched 17:32:05.076112 bus /sierra_2: Setting Powered False 17:32:06.142217 run create_hlr_db(pid=10958): Terminated: ok {rc=0} 17:32:06.587692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10960): Launched 17:32:06.899963 run osmo-hlr_10.42.42.2(pid=10961): Launched 17:32:07.019543 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:07.553579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10963): Launched 17:32:07.865258 run osmo-stp_10.42.42.5(pid=10964): Launched 17:32:07.983329 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:08.543432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10966): Launched 17:32:08.853173 run osmo-msc_10.42.42.6(pid=10967): Launched 17:32:09.026960 run osmo-stp_10.42.42.5(pid=10964): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10964)] 17:32:09.157202 run osmo-stp_10.42.42.5(pid=10964): stdout: | (launched: 2022-12-13_17:32:07.807953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:09.288209 run osmo-stp_10.42.42.5(pid=10964): stderr: | [0;m[38;5;43m20221213173207977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173207977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173207978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173207978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:09.417370 run osmo-stp_10.42.42.5(pid=10964): stdout: | (launched: 2022-12-13_17:32:07.807953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:09.540290 run osmo-stp_10.42.42.5(pid=10964): stderr: | [0;m[38;5;43m20221213173207977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173207977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173207978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173207978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173207979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:09.687922 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10964): Process ended prematurely: osmo-stp_10.42.42.5(pid=10964) [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10964)] [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:32:09.696999 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:32:09.723374 run osmo-hlr_10.42.42.2(pid=10961): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10961)] 17:32:09.771413 run osmo-hlr_10.42.42.2(pid=10961): stdout: | (launched: 2022-12-13_17:32:06.842458) 17:32:09.821399 run osmo-hlr_10.42.42.2(pid=10961): stderr: | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173207016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173207033 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173207043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173207043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173207043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:09.891136 run osmo-msc_10.42.42.6(pid=10967): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10967)] 17:32:09.939307 run osmo-msc_10.42.42.6(pid=10967): stdout: | (launched: 2022-12-13_17:32:08.796442) 17:32:09.989156 run osmo-msc_10.42.42.6(pid=10967): stderr: | [0;m[38;5;43m20221213173209066 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173209066 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f27b8aa0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173209066 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173209066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173209066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173209067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173209068 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173209069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173209069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173209069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:10.039471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10960): Terminating (SIGTERM) 17:32:10.079749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10963): Terminating (SIGTERM) 17:32:10.120177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10966): Terminating (SIGTERM) 17:32:10.160777 --- ParallelTerminationStrategy: PID 10960 died... 17:32:10.180090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10960): Terminated: ok {rc=0} 17:32:10.224432 --- ParallelTerminationStrategy: PID 10963 died... 17:32:10.243493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10963): Terminated: ok {rc=0} 17:32:10.287902 --- ParallelTerminationStrategy: PID 10966 died... 17:32:10.306875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10966): Terminated: ok {rc=0} 17:32:10.394566 bus /sierra_3: Setting Powered False 17:32:11.496081 bus /sierra_3: Setting Powered False 17:32:12.611317 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:trx-b200 --------------------------------------------------------------------- 17:32:13.866381 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:13.871124 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:13.905399 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:32:13.933541 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:14.020468 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:14.054938 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:32:14.083119 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:14.667320 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 17:32:14.672605 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:14.683855 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:14.734613 tst emergency_mo_mt_call.py: using LAC 35153 17:32:14.864505 tst emergency_mo_mt_call.py: using RAC 218 17:32:14.991472 tst emergency_mo_mt_call.py: using CellId 35153 17:32:15.120235 tst emergency_mo_mt_call.py: using BVCI 35154 17:32:15.239058 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.250294 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.261347 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.272390 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.283687 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:15.294994 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:15.414707 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:15.535936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:16.067631 run create_hlr_db(pid=10973): Launched 17:32:16.218444 bus /sierra_2: Setting Powered False 17:32:17.281679 run create_hlr_db(pid=10973): Terminated: ok {rc=0} 17:32:17.729708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Launched 17:32:18.056380 run osmo-hlr_10.42.42.2(pid=10976): Launched 17:32:18.181392 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:18.748478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Launched 17:32:19.075270 run osmo-stp_10.42.42.5(pid=10979): Launched 17:32:19.204628 tst emergency_mo_mt_call.py: using MSISDN 8249 17:32:19.367593 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:19.919160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10981): Launched 17:32:20.223752 run osmo-msc_10.42.42.6(pid=10982): Launched 17:32:20.392253 run osmo-stp_10.42.42.5(pid=10979): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] 17:32:20.521527 run osmo-stp_10.42.42.5(pid=10979): stdout: | (launched: 2022-12-13_17:32:19.015494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:20.650429 run osmo-stp_10.42.42.5(pid=10979): stderr: | [0;m[38;5;43m20221213173219187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173219188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173219188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173219188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:20.776895 run osmo-stp_10.42.42.5(pid=10979): stdout: | (launched: 2022-12-13_17:32:19.015494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:20.898127 run osmo-stp_10.42.42.5(pid=10979): stderr: | [0;m[38;5;43m20221213173219187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173219188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173219188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173219188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173219189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:21.043914 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10979): Process ended prematurely: osmo-stp_10.42.42.5(pid=10979) [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 17:32:21.052386 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 17:32:21.078843 run osmo-hlr_10.42.42.2(pid=10976): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10976)] 17:32:21.127783 run osmo-hlr_10.42.42.2(pid=10976): stdout: | (launched: 2022-12-13_17:32:17.997192) 17:32:21.178384 run osmo-hlr_10.42.42.2(pid=10976): stderr: | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173218191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173218204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173218213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173218213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173218213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:21.249117 run osmo-msc_10.42.42.6(pid=10982): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10982)] 17:32:21.297834 run osmo-msc_10.42.42.6(pid=10982): stdout: | (launched: 2022-12-13_17:32:20.167603) 17:32:21.348353 run osmo-msc_10.42.42.6(pid=10982): stderr: | [0;m[38;5;43m20221213173220437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173220437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8658d2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173220437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173220437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173220437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173220438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173220439 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173220440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173220440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173220440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:21.398982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Terminating (SIGTERM) 17:32:21.439278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Terminating (SIGTERM) 17:32:21.479790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10981): Terminating (SIGTERM) 17:32:21.520532 --- ParallelTerminationStrategy: PID 10975 died... 17:32:21.540135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Terminated: ok {rc=0} 17:32:21.585060 --- ParallelTerminationStrategy: PID 10978 died... 17:32:21.604029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Terminated: ok {rc=0} 17:32:21.648860 --- ParallelTerminationStrategy: PID 10981 died... 17:32:21.668315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10981): Terminated: ok {rc=0} 17:32:21.756392 bus /sierra_3: Setting Powered False 17:32:22.858217 bus /sierra_3: Setting Powered False 17:32:23.976267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 17:32:25.066879 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.078486 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:25.129404 tst emergency_preemptive_call.py: using LAC 35154 17:32:25.251642 tst emergency_preemptive_call.py: using RAC 219 17:32:25.372797 tst emergency_preemptive_call.py: using CellId 35154 17:32:25.493978 tst emergency_preemptive_call.py: using BVCI 35155 17:32:25.606074 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.616765 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.627386 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.637917 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.648364 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:25.658953 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:25.776582 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:25.899073 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:26.016816 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:26.138319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:26.647784 run create_hlr_db(pid=10984): Launched 17:32:26.773277 bus /sierra_2: Setting Powered False 17:32:27.838336 run create_hlr_db(pid=10984): Terminated: ok {rc=0} 17:32:28.278326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10986): Launched 17:32:28.587391 run osmo-hlr_10.42.42.2(pid=10987): Launched 17:32:28.703558 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:29.234331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10989): Launched 17:32:29.538535 run osmo-stp_10.42.42.5(pid=10990): Launched 17:32:29.663391 tst emergency_preemptive_call.py: using MSISDN 8250 17:32:29.831296 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:30.378940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10992): Launched 17:32:30.683115 run osmo-msc_10.42.42.6(pid=10993): Launched 17:32:30.880323 run osmo-stp_10.42.42.5(pid=10990): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10990)] 17:32:31.082183 run osmo-stp_10.42.42.5(pid=10990): stdout: | (launched: 2022-12-13_17:32:29.482513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:31.321861 run osmo-stp_10.42.42.5(pid=10990): stderr: | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173229650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:31.450175 run osmo-stp_10.42.42.5(pid=10990): stdout: | (launched: 2022-12-13_17:32:29.482513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:31.573037 run osmo-stp_10.42.42.5(pid=10990): stderr: | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173229649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173229650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173229650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:31.765846 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10990): Process ended prematurely: osmo-stp_10.42.42.5(pid=10990) [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10990)] [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py:32] 17:32:31.778971 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 17:32:31.815182 run osmo-hlr_10.42.42.2(pid=10987): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10987)] 17:32:31.886314 run osmo-hlr_10.42.42.2(pid=10987): stdout: | (launched: 2022-12-13_17:32:28.531269) 17:32:31.952598 run osmo-hlr_10.42.42.2(pid=10987): stderr: | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173228707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173228719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173228728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173228728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173228728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:32.027990 run osmo-msc_10.42.42.6(pid=10993): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10993)] 17:32:32.079765 run osmo-msc_10.42.42.6(pid=10993): stdout: | (launched: 2022-12-13_17:32:30.627164) 17:32:32.133319 run osmo-msc_10.42.42.6(pid=10993): stderr: | [0;m[38;5;43m20221213173230955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173230956 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ba579fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173230956 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173230956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173230956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173230956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173230958 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173230958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173230959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173230959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:32.187345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10986): Terminating (SIGTERM) 17:32:32.229808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10989): Terminating (SIGTERM) 17:32:32.272656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10992): Terminating (SIGTERM) 17:32:32.315805 --- ParallelTerminationStrategy: PID 10986 died... 17:32:32.336630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10986): Terminated: ok {rc=0} 17:32:32.383668 --- ParallelTerminationStrategy: PID 10989 died... 17:32:32.404323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10989): Terminated: ok {rc=0} 17:32:32.451290 --- ParallelTerminationStrategy: PID 10992 died... 17:32:32.470988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10992): Terminated: ok {rc=0} 17:32:32.557043 bus /sierra_9: Setting Powered False 17:32:33.656673 bus /sierra_9: Setting Powered False 17:32:34.779282 bus /sierra_8: Setting Powered False 17:32:35.880622 bus /sierra_8: Setting Powered False 17:32:36.997333 bus /sierra_3: Setting Powered False 17:32:38.098130 bus /sierra_3: Setting Powered False 17:32:39.216048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-b200 --------------------------------------------------------------------- 17:32:40.503916 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:40.508557 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:40.542770 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 17:32:40.583020 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:40.673320 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:40.710002 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 17:32:40.749959 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:41.338994 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 17:32:41.394038 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.405077 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:41.458864 tst cs_paging_gprs_active.py: using LAC 35155 17:32:41.581713 tst cs_paging_gprs_active.py: using RAC 220 17:32:41.702045 tst cs_paging_gprs_active.py: using CellId 35155 17:32:41.822220 tst cs_paging_gprs_active.py: using BVCI 35156 17:32:41.936661 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.947527 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.958162 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.968420 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.978830 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.989655 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:41.999988 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:42.010938 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:42.021569 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:42.146510 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:42.267200 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:32:42.477364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:42.790300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Launched 17:32:43.063727 run iperf3-srv_10.42.42.10(pid=11000): Launched 17:32:43.180345 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:32:43.389920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:43.702136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Launched 17:32:43.975798 run iperf3-srv_10.42.42.10(pid=11002): Launched 17:32:44.091965 tst cs_paging_gprs_active.py:38: start network... 17:32:44.299737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:44.780802 run create_hlr_db(pid=11003): Launched 17:32:44.907948 bus /sierra_2: Setting Powered False 17:32:45.978954 run create_hlr_db(pid=11003): Terminated: ok {rc=0} 17:32:46.457912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Launched 17:32:46.865658 run osmo-hlr_10.42.42.2(pid=11006): Launched 17:32:47.135957 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:47.774053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Launched 17:32:48.108121 run osmo-stp_10.42.42.5(pid=11009): Launched 17:32:48.235904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:32:48.811805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Launched 17:32:48.943202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:32:49.226548 run patchelf(pid=11012): Launched 17:32:49.414664 run osmo-stp_10.42.42.5(pid=11009): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] 17:32:49.556809 run osmo-stp_10.42.42.5(pid=11009): stdout: | (launched: 2022-12-13_17:32:48.047263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:49.700111 run osmo-stp_10.42.42.5(pid=11009): stderr: | [0;m[38;5;43m20221213173248236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173248237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173248237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173248237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:49.843468 run osmo-stp_10.42.42.5(pid=11009): stdout: | (launched: 2022-12-13_17:32:48.047263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:49.980580 run osmo-stp_10.42.42.5(pid=11009): stderr: | [0;m[38;5;43m20221213173248236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173248237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173248237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173248237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173248238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:50.143574 run patchelf(pid=11012): Terminating (SIGINT) 17:32:50.332858 run patchelf(pid=11012): Terminated: ok {rc=0} 17:32:50.469871 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11009): Process ended prematurely: osmo-stp_10.42.42.5(pid=11009) [trial-2392↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] [trial-2392↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 17:32:50.480284 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 17:32:50.509465 run osmo-hlr_10.42.42.2(pid=11006): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11006)] 17:32:50.561317 run osmo-hlr_10.42.42.2(pid=11006): stdout: | (launched: 2022-12-13_17:32:46.793469) 17:32:50.614802 run osmo-hlr_10.42.42.2(pid=11006): stderr: | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173247051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173247071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173247084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173247084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173247084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:50.668209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Terminating (SIGTERM) 17:32:50.711450 run iperf3-srv_10.42.42.10(pid=11000): Terminating (SIGTERM) 17:32:50.754410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Terminating (SIGTERM) 17:32:50.797330 run iperf3-srv_10.42.42.10(pid=11002): Terminating (SIGTERM) 17:32:50.840135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Terminating (SIGTERM) 17:32:50.883077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Terminating (SIGTERM) 17:32:50.926058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Terminating (SIGTERM) 17:32:50.969436 --- ParallelTerminationStrategy: PID 10999 died... 17:32:50.990388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Terminated: ok {rc=0} 17:32:51.038511 --- ParallelTerminationStrategy: PID 11000 died... 17:32:51.058828 run iperf3-srv_10.42.42.10(pid=11000): Terminated {rc=256} 17:32:51.106670 --- ParallelTerminationStrategy: PID 11001 died... 17:32:51.126921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Terminated: ok {rc=0} 17:32:51.174353 --- ParallelTerminationStrategy: PID 11002 died... 17:32:51.194503 run iperf3-srv_10.42.42.10(pid=11002): Terminated {rc=256} 17:32:51.241524 --- ParallelTerminationStrategy: PID 11005 died... 17:32:51.261742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Terminated: ok {rc=0} 17:32:51.309149 --- ParallelTerminationStrategy: PID 11008 died... 17:32:51.329429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Terminated: ok {rc=0} 17:32:51.376749 --- ParallelTerminationStrategy: PID 11011 died... 17:32:51.397197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Terminated: ok {rc=0} 17:32:51.487702 bus /gobi_0: Setting Powered False 17:32:52.589763 bus /gobi_0: Setting Powered False 17:32:53.711209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200 iperf3.py ---------------------------------------------- 17:32:54.861878 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:54.873341 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:54.925577 tst iperf3.py: using LAC 35156 17:32:55.048739 tst iperf3.py: using RAC 221 17:32:55.173100 tst iperf3.py: using CellId 35156 17:32:55.299679 tst iperf3.py: using BVCI 35157 17:32:55.415828 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.426711 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.437422 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.447791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.458143 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.469163 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.480047 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.491030 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.501720 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:55.626474 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:32:55.852051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:56.187581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11013): Launched 17:32:56.479959 run iperf3-srv_10.42.42.10(pid=11014): Launched 17:32:56.605415 tst iperf3.py:8: start network... 17:32:56.830714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:57.345765 run create_hlr_db(pid=11015): Launched 17:32:57.473533 bus /gobi_6: Setting Powered False 17:32:58.539289 run create_hlr_db(pid=11015): Terminated: ok {rc=0} 17:32:59.001330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11018): Launched 17:32:59.333177 run osmo-hlr_10.42.42.2(pid=11019): Launched 17:32:59.459984 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:00.032035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11021): Launched 17:33:00.366140 run osmo-stp_10.42.42.5(pid=11022): Launched 17:33:00.494338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:01.073513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11024): Launched 17:33:01.210227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:01.483518 run patchelf(pid=11026): Launched 17:33:01.681795 run osmo-stp_10.42.42.5(pid=11022): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11022)] 17:33:01.818031 run osmo-stp_10.42.42.5(pid=11022): stdout: | (launched: 2022-12-13_17:33:00.305289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:01.957497 run osmo-stp_10.42.42.5(pid=11022): stderr: | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173300496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:02.096936 run osmo-stp_10.42.42.5(pid=11022): stdout: | (launched: 2022-12-13_17:33:00.305289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:02.228666 run osmo-stp_10.42.42.5(pid=11022): stderr: | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173300495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173300496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173300496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:02.383818 run patchelf(pid=11026): Terminating (SIGINT) 17:33:02.561420 run patchelf(pid=11026): Terminated: ok {rc=0} 17:33:02.690720 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11022): Process ended prematurely: osmo-stp_10.42.42.5(pid=11022) [trial-2392↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11022)] [trial-2392↪gprs:trx-b200↪iperf3.py:8] 17:33:02.700395 tst iperf3.py:8: Test FAILED (7.9 sec) 17:33:02.727930 run osmo-hlr_10.42.42.2(pid=11019): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11019)] 17:33:02.776519 run osmo-hlr_10.42.42.2(pid=11019): stdout: | (launched: 2022-12-13_17:32:59.272616) 17:33:02.827003 run osmo-hlr_10.42.42.2(pid=11019): stderr: | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173259468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173259480 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173259489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173259489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173259489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:02.878147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11013): Terminating (SIGTERM) 17:33:02.918978 run iperf3-srv_10.42.42.10(pid=11014): Terminating (SIGTERM) 17:33:02.959593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11018): Terminating (SIGTERM) 17:33:03.000441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11021): Terminating (SIGTERM) 17:33:03.041170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11024): Terminating (SIGTERM) 17:33:03.082105 --- ParallelTerminationStrategy: PID 11013 died... 17:33:03.101723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11013): Terminated: ok {rc=0} 17:33:03.146958 --- ParallelTerminationStrategy: PID 11014 died... 17:33:03.165987 run iperf3-srv_10.42.42.10(pid=11014): Terminated {rc=256} 17:33:03.210680 --- ParallelTerminationStrategy: PID 11018 died... 17:33:03.229898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11018): Terminated: ok {rc=0} 17:33:03.274693 --- ParallelTerminationStrategy: PID 11021 died... 17:33:03.293801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11021): Terminated: ok {rc=0} 17:33:03.338649 --- ParallelTerminationStrategy: PID 11024 died... 17:33:03.358009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11024): Terminated: ok {rc=0} 17:33:03.445090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 17:33:04.592915 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:04.604445 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:04.653875 tst iperf3m4.py: using LAC 35157 17:33:04.776636 tst iperf3m4.py: using RAC 222 17:33:04.900010 tst iperf3m4.py: using CellId 35157 17:33:05.023107 tst iperf3m4.py: using BVCI 35158 17:33:05.137974 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.148805 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.159512 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.170311 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.180625 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.191660 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.202458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.213031 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:05.224042 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:05.343252 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:05.468565 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:05.589332 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:05.712396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:05.937859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:06.273050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11027): Launched 17:33:06.564525 run iperf3-srv_10.42.42.10(pid=11028): Launched 17:33:06.689511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:33:06.914105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:07.248755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11029): Launched 17:33:07.539240 run iperf3-srv_10.42.42.10(pid=11030): Launched 17:33:07.665446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:33:07.889956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:08.224712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11031): Launched 17:33:08.514638 run iperf3-srv_10.42.42.10(pid=11032): Launched 17:33:08.640576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:33:08.864598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:09.199408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11033): Launched 17:33:09.490768 run iperf3-srv_10.42.42.10(pid=11034): Launched 17:33:09.616779 tst iperf3m4.py:8: start network... 17:33:09.841512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:10.357174 run create_hlr_db(pid=11035): Launched 17:33:10.484042 bus /gobi_6: Setting Powered False 17:33:11.550282 run create_hlr_db(pid=11035): Terminated: ok {rc=0} 17:33:12.013717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Launched 17:33:12.348789 run osmo-hlr_10.42.42.2(pid=11038): Launched 17:33:12.476353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:13.054728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Launched 17:33:13.387955 run osmo-stp_10.42.42.5(pid=11041): Launched 17:33:13.514694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:14.087852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11043): Launched 17:33:14.216352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:14.497744 run patchelf(pid=11044): Launched 17:33:14.684508 run osmo-stp_10.42.42.5(pid=11041): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] 17:33:14.826952 run osmo-stp_10.42.42.5(pid=11041): stdout: | (launched: 2022-12-13_17:33:13.327263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:14.970592 run osmo-stp_10.42.42.5(pid=11041): stderr: | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173313518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:15.114591 run osmo-stp_10.42.42.5(pid=11041): stdout: | (launched: 2022-12-13_17:33:13.327263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:15.251864 run osmo-stp_10.42.42.5(pid=11041): stderr: | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173313517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173313518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173313518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:15.414562 run patchelf(pid=11044): Terminating (SIGINT) 17:33:15.605196 run patchelf(pid=11044): Terminated: ok {rc=0} 17:33:15.741891 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11041): Process ended prematurely: osmo-stp_10.42.42.5(pid=11041) [trial-2392↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] [trial-2392↪gprs:trx-b200↪iperf3m4.py:8] 17:33:15.752251 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:33:15.781451 run osmo-hlr_10.42.42.2(pid=11038): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11038)] 17:33:15.842028 run osmo-hlr_10.42.42.2(pid=11038): stdout: | (launched: 2022-12-13_17:33:12.287710) 17:33:15.914386 run osmo-hlr_10.42.42.2(pid=11038): stderr: | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173312483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173312495 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173312504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173312504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173312504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:15.970026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11027): Terminating (SIGTERM) 17:33:16.013791 run iperf3-srv_10.42.42.10(pid=11028): Terminating (SIGTERM) 17:33:16.060216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11029): Terminating (SIGTERM) 17:33:16.106392 run iperf3-srv_10.42.42.10(pid=11030): Terminating (SIGTERM) 17:33:16.152666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11031): Terminating (SIGTERM) 17:33:16.198205 run iperf3-srv_10.42.42.10(pid=11032): Terminating (SIGTERM) 17:33:16.244564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11033): Terminating (SIGTERM) 17:33:16.289935 run iperf3-srv_10.42.42.10(pid=11034): Terminating (SIGTERM) 17:33:16.336413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Terminating (SIGTERM) 17:33:16.382045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Terminating (SIGTERM) 17:33:16.427225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11043): Terminating (SIGTERM) 17:33:16.472276 --- ParallelTerminationStrategy: PID 11027 died... 17:33:16.494555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11027): Terminated: ok {rc=0} 17:33:16.544393 --- ParallelTerminationStrategy: PID 11028 died... 17:33:16.566432 run iperf3-srv_10.42.42.10(pid=11028): Terminated {rc=256} 17:33:16.616000 --- ParallelTerminationStrategy: PID 11029 died... 17:33:16.637949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11029): Terminated: ok {rc=0} 17:33:16.687436 --- ParallelTerminationStrategy: PID 11030 died... 17:33:16.709262 run iperf3-srv_10.42.42.10(pid=11030): Terminated {rc=256} 17:33:16.758660 --- ParallelTerminationStrategy: PID 11031 died... 17:33:16.780628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11031): Terminated: ok {rc=0} 17:33:16.829855 --- ParallelTerminationStrategy: PID 11032 died... 17:33:16.851634 run iperf3-srv_10.42.42.10(pid=11032): Terminated {rc=256} 17:33:16.901012 --- ParallelTerminationStrategy: PID 11033 died... 17:33:16.922989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11033): Terminated: ok {rc=0} 17:33:16.972333 --- ParallelTerminationStrategy: PID 11034 died... 17:33:16.994464 run iperf3-srv_10.42.42.10(pid=11034): Terminated {rc=256} 17:33:17.043915 --- ParallelTerminationStrategy: PID 11037 died... 17:33:17.066009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Terminated: ok {rc=0} 17:33:17.115541 --- ParallelTerminationStrategy: PID 11040 died... 17:33:17.137556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Terminated: ok {rc=0} 17:33:17.187644 --- ParallelTerminationStrategy: PID 11043 died... 17:33:17.208261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11043): Terminated: ok {rc=0} 17:33:17.299853 bus /gobi_4: Setting Powered False 17:33:18.400434 bus /gobi_4: Setting Powered False 17:33:19.519904 bus /gobi_1: Setting Powered False 17:33:20.620069 bus /gobi_1: Setting Powered False 17:33:21.740179 bus /gobi_0: Setting Powered False 17:33:22.841027 bus /gobi_0: Setting Powered False 17:33:23.960703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200 ping.py ---------------------------------------------- 17:33:25.066283 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.078415 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:25.130315 tst ping.py: using LAC 35158 17:33:25.252853 tst ping.py: using RAC 223 17:33:25.382614 tst ping.py: using CellId 35158 17:33:25.514693 tst ping.py: using BVCI 35159 17:33:25.635718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.647113 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.658419 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.669600 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.680862 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.692256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.703641 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:25.715068 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:25.836582 tst ping.py:19: start network... 17:33:26.058068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:26.563835 run create_hlr_db(pid=11045): Launched 17:33:26.689100 bus /gobi_6: Setting Powered False 17:33:27.754146 run create_hlr_db(pid=11045): Terminated: ok {rc=0} 17:33:28.192341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11047): Launched 17:33:28.500373 run osmo-hlr_10.42.42.2(pid=11048): Launched 17:33:28.617709 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:29.184461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11050): Launched 17:33:29.512486 run osmo-stp_10.42.42.5(pid=11051): Launched 17:33:29.638114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:30.203628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11053): Launched 17:33:30.330155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:30.607130 run patchelf(pid=11054): Launched 17:33:30.790695 run osmo-stp_10.42.42.5(pid=11051): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11051)] 17:33:30.932225 run osmo-stp_10.42.42.5(pid=11051): stdout: | (launched: 2022-12-13_17:33:29.452523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:31.075913 run osmo-stp_10.42.42.5(pid=11051): stderr: | [0;m[38;5;43m20221213173329641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173329641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173329642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173329642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173329642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173329643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173329643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:31.221335 run osmo-stp_10.42.42.5(pid=11051): stdout: | (launched: 2022-12-13_17:33:29.452523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:31.359320 run osmo-stp_10.42.42.5(pid=11051): stderr: | [0;m[38;5;43m20221213173329641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173329641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173329642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173329642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173329642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173329643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173329643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:31.523117 run patchelf(pid=11054): Terminating (SIGINT) 17:33:31.711682 run patchelf(pid=11054): Terminated: ok {rc=0} 17:33:31.847344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11051): Process ended prematurely: osmo-stp_10.42.42.5(pid=11051) [trial-2392↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11051)] [trial-2392↪gprs:trx-b200↪ping.py:22] 17:33:31.857664 tst ping.py:22: Test FAILED (6.8 sec) 17:33:31.886973 run osmo-hlr_10.42.42.2(pid=11048): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11048)] 17:33:31.939568 run osmo-hlr_10.42.42.2(pid=11048): stdout: | (launched: 2022-12-13_17:33:28.444278) 17:33:31.993676 run osmo-hlr_10.42.42.2(pid=11048): stderr: | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173328615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173328627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173328635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173328635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173328635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:32.049687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11047): Terminating (SIGTERM) 17:33:32.096532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11050): Terminating (SIGTERM) 17:33:32.143451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11053): Terminating (SIGTERM) 17:33:32.190065 --- ParallelTerminationStrategy: PID 11047 died... 17:33:32.212456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11047): Terminated: ok {rc=0} 17:33:32.262298 --- ParallelTerminationStrategy: PID 11050 died... 17:33:32.283281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11050): Terminated: ok {rc=0} 17:33:32.332059 --- ParallelTerminationStrategy: PID 11053 died... 17:33:32.352570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11053): Terminated: ok {rc=0} 17:33:32.443072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 17:33:33.532216 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:33.544020 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:33.594737 tst ping_idle_ping.py: using LAC 35159 17:33:33.725392 tst ping_idle_ping.py: using RAC 224 17:33:33.854089 tst ping_idle_ping.py: using CellId 35159 17:33:33.982182 tst ping_idle_ping.py: using BVCI 35160 17:33:34.104000 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.115612 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.126839 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.138040 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.149780 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.161491 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.173498 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:34.184861 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:34.304357 tst ping_idle_ping.py:24: start network... 17:33:34.510576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:34.986667 run create_hlr_db(pid=11055): Launched 17:33:35.111754 bus /gobi_6: Setting Powered False 17:33:36.174005 run create_hlr_db(pid=11055): Terminated: ok {rc=0} 17:33:36.621745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Launched 17:33:36.949084 run osmo-hlr_10.42.42.2(pid=11058): Launched 17:33:37.072717 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:37.641559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Launched 17:33:37.969789 run osmo-stp_10.42.42.5(pid=11061): Launched 17:33:38.095133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:38.659095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Launched 17:33:38.786133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:39.063045 run patchelf(pid=11064): Launched 17:33:39.247424 run osmo-stp_10.42.42.5(pid=11061): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] 17:33:39.386943 run osmo-stp_10.42.42.5(pid=11061): stdout: | (launched: 2022-12-13_17:33:37.909882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:39.528218 run osmo-stp_10.42.42.5(pid=11061): stderr: | [0;m[38;5;43m20221213173338098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173338099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173338099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173338099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:39.668897 run osmo-stp_10.42.42.5(pid=11061): stdout: | (launched: 2022-12-13_17:33:37.909882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:39.803864 run osmo-stp_10.42.42.5(pid=11061): stderr: | [0;m[38;5;43m20221213173338098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173338099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173338099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173338099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173338100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:39.964143 run patchelf(pid=11064): Terminating (SIGINT) 17:33:40.150302 run patchelf(pid=11064): Terminated: ok {rc=0} 17:33:40.283931 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11061): Process ended prematurely: osmo-stp_10.42.42.5(pid=11061) [trial-2392↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] [trial-2392↪gprs:trx-b200↪ping_idle_ping.py:27] 17:33:40.293621 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:33:40.321966 run osmo-hlr_10.42.42.2(pid=11058): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11058)] 17:33:40.373462 run osmo-hlr_10.42.42.2(pid=11058): stdout: | (launched: 2022-12-13_17:33:36.889197) 17:33:40.425952 run osmo-hlr_10.42.42.2(pid=11058): stderr: | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173337084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173337097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173337105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173337106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173337106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:40.478874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Terminating (SIGTERM) 17:33:40.521440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Terminating (SIGTERM) 17:33:40.564725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Terminating (SIGTERM) 17:33:40.607760 --- ParallelTerminationStrategy: PID 11057 died... 17:33:40.628354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Terminated: ok {rc=0} 17:33:40.675811 --- ParallelTerminationStrategy: PID 11060 died... 17:33:40.695928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Terminated: ok {rc=0} 17:33:40.743217 --- ParallelTerminationStrategy: PID 11063 died... 17:33:40.763321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Terminated: ok {rc=0} 17:33:40.853547 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 17:33:42.164116 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:33:42.170188 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:33:42.203904 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:33:42.243842 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:33:42.334504 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:33:42.367249 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:33:42.405575 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:33:43.001858 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:33:43.056042 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.067328 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:43.117894 tst cs_paging_gprs_active.py: using LAC 35160 17:33:43.250794 tst cs_paging_gprs_active.py: using RAC 225 17:33:43.383418 tst cs_paging_gprs_active.py: using CellId 35160 17:33:43.516688 tst cs_paging_gprs_active.py: using BVCI 35161 17:33:43.640105 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.651526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.662703 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.674365 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.685939 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.697540 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.709413 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.720781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:43.732526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:43.853465 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:43.972690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:33:44.182881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:44.496927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Launched 17:33:44.770755 run iperf3-srv_10.42.42.10(pid=11070): Launched 17:33:44.888618 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:33:45.098774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:45.413755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Launched 17:33:45.686962 run iperf3-srv_10.42.42.10(pid=11072): Launched 17:33:45.805719 tst cs_paging_gprs_active.py:38: start network... 17:33:46.054734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:46.591906 run create_hlr_db(pid=11073): Launched 17:33:46.728895 bus /gobi_6: Setting Powered False 17:33:47.793826 run create_hlr_db(pid=11073): Terminated: ok {rc=0} 17:33:48.242679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Launched 17:33:48.580386 run osmo-hlr_10.42.42.2(pid=11076): Launched 17:33:48.709094 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:49.285384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Launched 17:33:49.619919 run osmo-stp_10.42.42.5(pid=11079): Launched 17:33:49.746773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:50.322693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Launched 17:33:50.451496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:50.734003 run patchelf(pid=11082): Launched 17:33:50.920207 run osmo-stp_10.42.42.5(pid=11079): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] 17:33:51.062334 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-13_17:33:49.558864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:51.206767 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173349750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:51.350283 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-13_17:33:49.558864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:51.487464 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173349749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173349750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173349750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:51.650553 run patchelf(pid=11082): Terminating (SIGINT) 17:33:51.840475 run patchelf(pid=11082): Terminated: ok {rc=0} 17:33:51.977894 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:33:51.988398 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:33:52.017521 run osmo-hlr_10.42.42.2(pid=11076): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11076)] 17:33:52.069607 run osmo-hlr_10.42.42.2(pid=11076): stdout: | (launched: 2022-12-13_17:33:48.519429) 17:33:52.123789 run osmo-hlr_10.42.42.2(pid=11076): stderr: | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173348718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173348729 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173348738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173348738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173348738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:52.177707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Terminating (SIGTERM) 17:33:52.221054 run iperf3-srv_10.42.42.10(pid=11070): Terminating (SIGTERM) 17:33:52.264615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminating (SIGTERM) 17:33:52.308016 run iperf3-srv_10.42.42.10(pid=11072): Terminating (SIGTERM) 17:33:52.351196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminating (SIGTERM) 17:33:52.394423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminating (SIGTERM) 17:33:52.437372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminating (SIGTERM) 17:33:52.480780 --- ParallelTerminationStrategy: PID 11069 died... 17:33:52.501641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Terminated: ok {rc=0} 17:33:52.548768 --- ParallelTerminationStrategy: PID 11070 died... 17:33:52.569035 run iperf3-srv_10.42.42.10(pid=11070): Terminated {rc=256} 17:33:52.615795 --- ParallelTerminationStrategy: PID 11071 died... 17:33:52.635933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminated: ok {rc=0} 17:33:52.683129 --- ParallelTerminationStrategy: PID 11072 died... 17:33:52.703406 run iperf3-srv_10.42.42.10(pid=11072): Terminated {rc=256} 17:33:52.750574 --- ParallelTerminationStrategy: PID 11075 died... 17:33:52.770865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminated: ok {rc=0} 17:33:52.818088 --- ParallelTerminationStrategy: PID 11078 died... 17:33:52.838502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminated: ok {rc=0} 17:33:52.885494 --- ParallelTerminationStrategy: PID 11081 died... 17:33:52.905814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminated: ok {rc=0} 17:33:52.995384 bus /gobi_0: Setting Powered False 17:33:54.095558 bus /gobi_0: Setting Powered False 17:33:55.213742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:33:56.366031 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:56.378064 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:56.432560 tst iperf3.py: using LAC 35161 17:33:56.564605 tst iperf3.py: using RAC 226 17:33:56.696461 tst iperf3.py: using CellId 35161 17:33:56.827359 tst iperf3.py: using BVCI 35162 17:33:56.950674 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:56.962218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:56.973516 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:56.984531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:56.995952 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:57.007332 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:57.019037 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:57.030450 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:57.042020 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:57.161380 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:57.371806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:57.686045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Launched 17:33:57.962794 run iperf3-srv_10.42.42.10(pid=11084): Launched 17:33:58.082290 tst iperf3.py:8: start network... 17:33:58.291826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:58.774305 run create_hlr_db(pid=11085): Launched 17:33:58.903977 bus /gobi_6: Setting Powered False 17:33:59.965569 run create_hlr_db(pid=11085): Terminated: ok {rc=0} 17:34:00.421659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11087): Launched 17:34:00.756544 run osmo-hlr_10.42.42.2(pid=11088): Launched 17:34:00.941117 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:01.694924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11090): Launched 17:34:02.027593 run osmo-stp_10.42.42.5(pid=11091): Launched 17:34:02.243150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:02.841969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11093): Launched 17:34:02.970044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:03.253128 run patchelf(pid=11094): Launched 17:34:03.439813 run osmo-stp_10.42.42.5(pid=11091): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11091)] 17:34:03.581435 run osmo-stp_10.42.42.5(pid=11091): stdout: | (launched: 2022-12-13_17:34:01.969785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:03.724801 run osmo-stp_10.42.42.5(pid=11091): stderr: | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173402323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:03.869051 run osmo-stp_10.42.42.5(pid=11091): stdout: | (launched: 2022-12-13_17:34:01.969785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:04.006184 run osmo-stp_10.42.42.5(pid=11091): stderr: | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173402322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173402323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173402323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:04.168932 run patchelf(pid=11094): Terminating (SIGINT) 17:34:04.358907 run patchelf(pid=11094): Terminated: ok {rc=0} 17:34:04.495290 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11091): Process ended prematurely: osmo-stp_10.42.42.5(pid=11091) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11091)] [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 17:34:04.505776 tst iperf3.py:8: Test FAILED (8.2 sec) 17:34:04.534914 run osmo-hlr_10.42.42.2(pid=11088): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11088)] 17:34:04.587243 run osmo-hlr_10.42.42.2(pid=11088): stdout: | (launched: 2022-12-13_17:34:00.695683) 17:34:04.640827 run osmo-hlr_10.42.42.2(pid=11088): stderr: | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173400924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173400959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173400976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173400976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173400976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:04.695059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Terminating (SIGTERM) 17:34:04.737909 run iperf3-srv_10.42.42.10(pid=11084): Terminating (SIGTERM) 17:34:04.781372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11087): Terminating (SIGTERM) 17:34:04.824503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11090): Terminating (SIGTERM) 17:34:04.867978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11093): Terminating (SIGTERM) 17:34:04.911178 --- ParallelTerminationStrategy: PID 11083 died... 17:34:04.931908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Terminated: ok {rc=0} 17:34:04.979445 --- ParallelTerminationStrategy: PID 11084 died... 17:34:04.999695 run iperf3-srv_10.42.42.10(pid=11084): Terminated {rc=256} 17:34:05.046980 --- ParallelTerminationStrategy: PID 11087 died... 17:34:05.067397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11087): Terminated: ok {rc=0} 17:34:05.114876 --- ParallelTerminationStrategy: PID 11090 died... 17:34:05.135481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11090): Terminated: ok {rc=0} 17:34:05.182744 --- ParallelTerminationStrategy: PID 11093 died... 17:34:05.202998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11093): Terminated: ok {rc=0} 17:34:05.293486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:34:06.447208 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:06.459314 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:06.510945 tst iperf3m4.py: using LAC 35162 17:34:06.643351 tst iperf3m4.py: using RAC 227 17:34:06.773738 tst iperf3m4.py: using CellId 35162 17:34:06.897161 tst iperf3m4.py: using BVCI 35163 17:34:07.011248 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.022161 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.032838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.043502 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.054132 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.065224 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.076361 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.086991 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:07.098435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:07.221805 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:07.342556 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:07.460311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:07.580081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:07.788855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:08.101431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11095): Launched 17:34:08.374283 run iperf3-srv_10.42.42.10(pid=11096): Launched 17:34:08.493582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:34:08.702156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:09.014580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Launched 17:34:09.288759 run iperf3-srv_10.42.42.10(pid=11098): Launched 17:34:09.405812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:34:09.614164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:09.927251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Launched 17:34:10.200264 run iperf3-srv_10.42.42.10(pid=11100): Launched 17:34:10.317335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:34:10.525772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:10.839625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Launched 17:34:11.111367 run iperf3-srv_10.42.42.10(pid=11102): Launched 17:34:11.227768 tst iperf3m4.py:8: start network... 17:34:11.435842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:11.917561 run create_hlr_db(pid=11103): Launched 17:34:12.044603 bus /gobi_6: Setting Powered False 17:34:13.106288 run create_hlr_db(pid=11103): Terminated: ok {rc=0} 17:34:13.561604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Launched 17:34:13.897460 run osmo-hlr_10.42.42.2(pid=11106): Launched 17:34:14.026003 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:14.602379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Launched 17:34:14.936022 run osmo-stp_10.42.42.5(pid=11109): Launched 17:34:15.063838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:15.640424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Launched 17:34:15.768576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:16.105861 run patchelf(pid=11112): Launched 17:34:16.307061 run osmo-stp_10.42.42.5(pid=11109): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] 17:34:16.451660 run osmo-stp_10.42.42.5(pid=11109): stdout: | (launched: 2022-12-13_17:34:14.875220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:16.598150 run osmo-stp_10.42.42.5(pid=11109): stderr: | [0;m[38;5;43m20221213173415064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173415065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173415065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173415065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:16.744341 run osmo-stp_10.42.42.5(pid=11109): stdout: | (launched: 2022-12-13_17:34:14.875220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:16.884237 run osmo-stp_10.42.42.5(pid=11109): stderr: | [0;m[38;5;43m20221213173415064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173415065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173415065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173415065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173415066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:17.050154 run patchelf(pid=11112): Terminating (SIGINT) 17:34:17.243922 run patchelf(pid=11112): Terminated: ok {rc=0} 17:34:17.381390 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11109): Process ended prematurely: osmo-stp_10.42.42.5(pid=11109) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 17:34:17.391847 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:34:17.421497 run osmo-hlr_10.42.42.2(pid=11106): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11106)] 17:34:17.473528 run osmo-hlr_10.42.42.2(pid=11106): stdout: | (launched: 2022-12-13_17:34:13.836085) 17:34:17.527223 run osmo-hlr_10.42.42.2(pid=11106): stderr: | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173414031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173414043 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173414054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173414055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173414055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:17.581333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11095): Terminating (SIGTERM) 17:34:17.623918 run iperf3-srv_10.42.42.10(pid=11096): Terminating (SIGTERM) 17:34:17.667205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Terminating (SIGTERM) 17:34:17.710365 run iperf3-srv_10.42.42.10(pid=11098): Terminating (SIGTERM) 17:34:17.753687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Terminating (SIGTERM) 17:34:17.797306 run iperf3-srv_10.42.42.10(pid=11100): Terminating (SIGTERM) 17:34:17.840561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminating (SIGTERM) 17:34:17.884004 run iperf3-srv_10.42.42.10(pid=11102): Terminating (SIGTERM) 17:34:17.926974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Terminating (SIGTERM) 17:34:17.971209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Terminating (SIGTERM) 17:34:18.014554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Terminating (SIGTERM) 17:34:18.058000 --- ParallelTerminationStrategy: PID 11095 died... 17:34:18.079028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11095): Terminated: ok {rc=0} 17:34:18.126917 --- ParallelTerminationStrategy: PID 11096 died... 17:34:18.147513 run iperf3-srv_10.42.42.10(pid=11096): Terminated {rc=256} 17:34:18.195006 --- ParallelTerminationStrategy: PID 11097 died... 17:34:18.215371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11097): Terminated: ok {rc=0} 17:34:18.262705 --- ParallelTerminationStrategy: PID 11098 died... 17:34:18.283018 run iperf3-srv_10.42.42.10(pid=11098): Terminated {rc=256} 17:34:18.330597 --- ParallelTerminationStrategy: PID 11099 died... 17:34:18.350912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11099): Terminated: ok {rc=0} 17:34:18.398453 --- ParallelTerminationStrategy: PID 11100 died... 17:34:18.418780 run iperf3-srv_10.42.42.10(pid=11100): Terminated {rc=256} 17:34:18.466233 --- ParallelTerminationStrategy: PID 11101 died... 17:34:18.486565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminated: ok {rc=0} 17:34:18.533982 --- ParallelTerminationStrategy: PID 11102 died... 17:34:18.554476 run iperf3-srv_10.42.42.10(pid=11102): Terminated {rc=256} 17:34:18.601909 --- ParallelTerminationStrategy: PID 11105 died... 17:34:18.622366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Terminated: ok {rc=0} 17:34:18.669885 --- ParallelTerminationStrategy: PID 11108 died... 17:34:18.690327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Terminated: ok {rc=0} 17:34:18.737838 --- ParallelTerminationStrategy: PID 11111 died... 17:34:18.758382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Terminated: ok {rc=0} 17:34:18.849502 bus /gobi_4: Setting Powered False 17:34:19.950781 bus /gobi_4: Setting Powered False 17:34:21.070154 bus /gobi_1: Setting Powered False 17:34:22.170889 bus /gobi_1: Setting Powered False 17:34:23.290023 bus /gobi_0: Setting Powered False 17:34:24.387592 bus /gobi_0: Setting Powered False 17:34:25.505936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 17:34:26.610057 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:26.621782 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:26.673112 tst ping.py: using LAC 35163 17:34:26.794332 tst ping.py: using RAC 228 17:34:26.916246 tst ping.py: using CellId 35163 17:34:27.037144 tst ping.py: using BVCI 35164 17:34:27.158371 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.169934 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.181249 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.192487 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.204007 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.215498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.227298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:27.238818 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:27.357068 tst ping.py:19: start network... 17:34:27.563479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:28.037092 run create_hlr_db(pid=11113): Launched 17:34:28.163252 bus /gobi_6: Setting Powered False 17:34:29.224277 run create_hlr_db(pid=11113): Terminated: ok {rc=0} 17:34:29.672405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Launched 17:34:30.000919 run osmo-hlr_10.42.42.2(pid=11116): Launched 17:34:30.125906 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:30.698497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Launched 17:34:31.039048 run osmo-stp_10.42.42.5(pid=11119): Launched 17:34:31.279985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:31.926911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Launched 17:34:32.065305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:32.349088 run patchelf(pid=11122): Launched 17:34:32.532104 run osmo-stp_10.42.42.5(pid=11119): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] 17:34:32.671302 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-13_17:34:30.978377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:32.812541 run osmo-stp_10.42.42.5(pid=11119): stderr: | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173431268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:32.953173 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-13_17:34:30.978377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:33.087796 run osmo-stp_10.42.42.5(pid=11119): stderr: | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173431268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173431268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173431273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:33.247754 run patchelf(pid=11122): Terminating (SIGINT) 17:34:33.432721 run patchelf(pid=11122): Terminated: ok {rc=0} 17:34:33.565998 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 17:34:33.575670 tst ping.py:22: Test FAILED (7.0 sec) 17:34:33.604193 run osmo-hlr_10.42.42.2(pid=11116): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11116)] 17:34:33.655925 run osmo-hlr_10.42.42.2(pid=11116): stdout: | (launched: 2022-12-13_17:34:29.940676) 17:34:33.709483 run osmo-hlr_10.42.42.2(pid=11116): stderr: | [0;m[1;31m20221213173430138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173430138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173430138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173430138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173430138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173430139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173430152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173430162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173430162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173430162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:33.762349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminating (SIGTERM) 17:34:33.805286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminating (SIGTERM) 17:34:33.848648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Terminating (SIGTERM) 17:34:33.892159 --- ParallelTerminationStrategy: PID 11115 died... 17:34:33.912882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminated: ok {rc=0} 17:34:33.960508 --- ParallelTerminationStrategy: PID 11118 died... 17:34:33.981026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminated: ok {rc=0} 17:34:34.028446 --- ParallelTerminationStrategy: PID 11121 died... 17:34:34.048781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11121): Terminated: ok {rc=0} 17:34:34.139360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:34:35.227927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.240228 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:35.292290 tst ping_idle_ping.py: using LAC 35164 17:34:35.418353 tst ping_idle_ping.py: using RAC 229 17:34:35.546785 tst ping_idle_ping.py: using CellId 35164 17:34:35.674009 tst ping_idle_ping.py: using BVCI 35165 17:34:35.795004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.806575 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.817973 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.829227 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.840650 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.852117 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.863806 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:35.875334 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:35.997741 tst ping_idle_ping.py:24: start network... 17:34:36.220741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:36.730518 run create_hlr_db(pid=11123): Launched 17:34:36.856188 bus /gobi_6: Setting Powered False 17:34:37.921541 run create_hlr_db(pid=11123): Terminated: ok {rc=0} 17:34:38.363184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11125): Launched 17:34:38.669410 run osmo-hlr_10.42.42.2(pid=11126): Launched 17:34:38.786022 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:39.317956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11128): Launched 17:34:39.626710 run osmo-stp_10.42.42.5(pid=11129): Launched 17:34:39.744692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:40.277215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11131): Launched 17:34:40.394710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:40.654416 run patchelf(pid=11132): Launched 17:34:40.824649 run osmo-stp_10.42.42.5(pid=11129): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11129)] 17:34:40.954517 run osmo-stp_10.42.42.5(pid=11129): stdout: | (launched: 2022-12-13_17:34:39.570301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:41.086449 run osmo-stp_10.42.42.5(pid=11129): stderr: | [0;m[38;5;43m20221213173439738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173439738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173439739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173439739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173439739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173439740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173439740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:41.219180 run osmo-stp_10.42.42.5(pid=11129): stdout: | (launched: 2022-12-13_17:34:39.570301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:41.344650 run osmo-stp_10.42.42.5(pid=11129): stderr: | [0;m[38;5;43m20221213173439738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173439738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173439739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173439739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173439739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173439740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173439740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:41.493310 run patchelf(pid=11132): Terminating (SIGINT) 17:34:41.667530 run patchelf(pid=11132): Terminated: ok {rc=0} 17:34:41.792809 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11129): Process ended prematurely: osmo-stp_10.42.42.5(pid=11129) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11129)] [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 17:34:41.801921 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:34:41.829156 run osmo-hlr_10.42.42.2(pid=11126): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11126)] 17:34:41.877967 run osmo-hlr_10.42.42.2(pid=11126): stdout: | (launched: 2022-12-13_17:34:38.612816) 17:34:41.928706 run osmo-hlr_10.42.42.2(pid=11126): stderr: | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173438786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173438799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173438808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173438808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173438808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:41.979710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11125): Terminating (SIGTERM) 17:34:42.020217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11128): Terminating (SIGTERM) 17:34:42.060600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11131): Terminating (SIGTERM) 17:34:42.101545 --- ParallelTerminationStrategy: PID 11125 died... 17:34:42.120495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11125): Terminated: ok {rc=0} 17:34:42.165741 --- ParallelTerminationStrategy: PID 11128 died... 17:34:42.185051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11128): Terminated: ok {rc=0} 17:34:42.229897 --- ParallelTerminationStrategy: PID 11131 died... 17:34:42.248835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11131): Terminated: ok {rc=0} 17:34:42.334864 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:34:43.640396 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:34:43.646430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:34:43.679109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:34:43.717189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:34:43.805968 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:34:43.841267 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:34:43.881515 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:34:44.469549 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:34:44.520474 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:44.531533 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:44.601995 tst cs_paging_gprs_active.py: using LAC 35165 17:34:44.726459 tst cs_paging_gprs_active.py: using RAC 230 17:34:44.849580 tst cs_paging_gprs_active.py: using CellId 35165 17:34:44.973250 tst cs_paging_gprs_active.py: using BVCI 35166 17:34:45.087914 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.098904 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.109620 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.120286 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.130921 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.141613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.152313 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.163459 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.174327 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:45.299219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:45.419808 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:34:45.629035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:45.955390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11137): Launched 17:34:46.265528 run iperf3-srv_10.42.42.10(pid=11138): Launched 17:34:46.384865 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:34:46.597704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:46.917734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11139): Launched 17:34:47.221710 run iperf3-srv_10.42.42.10(pid=11140): Launched 17:34:47.341323 tst cs_paging_gprs_active.py:38: start network... 17:34:47.551230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:48.035715 run create_hlr_db(pid=11141): Launched 17:34:48.163439 bus /gobi_6: Setting Powered False 17:34:49.225849 run create_hlr_db(pid=11141): Terminated: ok {rc=0} 17:34:49.681988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Launched 17:34:50.016539 run osmo-hlr_10.42.42.2(pid=11144): Launched 17:34:50.145777 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:50.725963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Launched 17:34:51.062476 run osmo-stp_10.42.42.5(pid=11147): Launched 17:34:51.189580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:51.764716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Launched 17:34:51.894732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:52.178851 run patchelf(pid=11150): Launched 17:34:52.365519 run osmo-stp_10.42.42.5(pid=11147): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] 17:34:52.507914 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-13_17:34:51.001422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:52.651935 run osmo-stp_10.42.42.5(pid=11147): stderr: | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173451191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:52.795846 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-13_17:34:51.001422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:52.933632 run osmo-stp_10.42.42.5(pid=11147): stderr: | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173451191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173451191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173451192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:53.096692 run patchelf(pid=11150): Terminating (SIGINT) 17:34:53.286909 run patchelf(pid=11150): Terminated: ok {rc=0} 17:34:53.423738 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:34:53.434161 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:34:53.463164 run osmo-hlr_10.42.42.2(pid=11144): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11144)] 17:34:53.516049 run osmo-hlr_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-13_17:34:49.956083) 17:34:53.570754 run osmo-hlr_10.42.42.2(pid=11144): stderr: | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173450151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173450163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173450171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173450172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173450172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:53.624925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11137): Terminating (SIGTERM) 17:34:53.668189 run iperf3-srv_10.42.42.10(pid=11138): Terminating (SIGTERM) 17:34:53.712084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11139): Terminating (SIGTERM) 17:34:53.755703 run iperf3-srv_10.42.42.10(pid=11140): Terminating (SIGTERM) 17:34:53.799122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminating (SIGTERM) 17:34:53.842478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminating (SIGTERM) 17:34:53.885920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminating (SIGTERM) 17:34:53.929454 --- ParallelTerminationStrategy: PID 11137 died... 17:34:53.949961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11137): Terminated: ok {rc=0} 17:34:53.997662 --- ParallelTerminationStrategy: PID 11138 died... 17:34:54.017857 run iperf3-srv_10.42.42.10(pid=11138): Terminated {rc=256} 17:34:54.065462 --- ParallelTerminationStrategy: PID 11139 died... 17:34:54.086103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11139): Terminated: ok {rc=0} 17:34:54.133886 --- ParallelTerminationStrategy: PID 11140 died... 17:34:54.154497 run iperf3-srv_10.42.42.10(pid=11140): Terminated {rc=256} 17:34:54.202437 --- ParallelTerminationStrategy: PID 11143 died... 17:34:54.223122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminated: ok {rc=0} 17:34:54.271399 --- ParallelTerminationStrategy: PID 11146 died... 17:34:54.292133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminated: ok {rc=0} 17:34:54.340030 --- ParallelTerminationStrategy: PID 11149 died... 17:34:54.360536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminated: ok {rc=0} 17:34:54.451391 bus /gobi_0: Setting Powered False 17:34:55.552481 bus /gobi_0: Setting Powered False 17:34:56.671653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:34:57.824394 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:57.836687 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:57.912075 tst iperf3.py: using LAC 35166 17:34:58.045606 tst iperf3.py: using RAC 231 17:34:58.175174 tst iperf3.py: using CellId 35166 17:34:58.303839 tst iperf3.py: using BVCI 35167 17:34:58.425795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.437229 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.448356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.459609 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.471124 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.482682 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.494676 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.506102 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:58.517740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:58.639944 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:58.864369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:59.198616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11151): Launched 17:34:59.489238 run iperf3-srv_10.42.42.10(pid=11152): Launched 17:34:59.615809 tst iperf3.py:8: start network... 17:34:59.840040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:00.354992 run create_hlr_db(pid=11153): Launched 17:35:00.481846 bus /gobi_6: Setting Powered False 17:35:01.574473 run create_hlr_db(pid=11153): Terminated: ok {rc=0} 17:35:02.118636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11158): Launched 17:35:02.446284 run osmo-hlr_10.42.42.2(pid=11159): Launched 17:35:02.566727 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:03.119403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11161): Launched 17:35:03.430176 run osmo-stp_10.42.42.5(pid=11162): Launched 17:35:03.550111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:04.085770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11164): Launched 17:35:04.205704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:04.470687 run patchelf(pid=11165): Launched 17:35:04.644044 run osmo-stp_10.42.42.5(pid=11162): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11162)] 17:35:04.775774 run osmo-stp_10.42.42.5(pid=11162): stdout: | (launched: 2022-12-13_17:35:03.373014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:04.908867 run osmo-stp_10.42.42.5(pid=11162): stderr: | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173503542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:05.041945 run osmo-stp_10.42.42.5(pid=11162): stdout: | (launched: 2022-12-13_17:35:03.373014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:05.168894 run osmo-stp_10.42.42.5(pid=11162): stderr: | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173503542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173503543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:05.319306 run patchelf(pid=11165): Terminating (SIGINT) 17:35:05.495947 run patchelf(pid=11165): Terminated: ok {rc=0} 17:35:05.623754 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11162): Process ended prematurely: osmo-stp_10.42.42.5(pid=11162) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11162)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 17:35:05.633242 tst iperf3.py:8: Test FAILED (7.8 sec) 17:35:05.660697 run osmo-hlr_10.42.42.2(pid=11159): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11159)] 17:35:05.709373 run osmo-hlr_10.42.42.2(pid=11159): stdout: | (launched: 2022-12-13_17:35:02.389208) 17:35:05.759724 run osmo-hlr_10.42.42.2(pid=11159): stderr: | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173502562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173502574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173502582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173502582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173502583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:05.810355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11151): Terminating (SIGTERM) 17:35:05.850975 run iperf3-srv_10.42.42.10(pid=11152): Terminating (SIGTERM) 17:35:05.892704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11158): Terminating (SIGTERM) 17:35:05.933947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11161): Terminating (SIGTERM) 17:35:05.974527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11164): Terminating (SIGTERM) 17:35:06.015262 --- ParallelTerminationStrategy: PID 11151 died... 17:35:06.035513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11151): Terminated: ok {rc=0} 17:35:06.080291 --- ParallelTerminationStrategy: PID 11152 died... 17:35:06.099413 run iperf3-srv_10.42.42.10(pid=11152): Terminated {rc=256} 17:35:06.143953 --- ParallelTerminationStrategy: PID 11158 died... 17:35:06.162995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11158): Terminated: ok {rc=0} 17:35:06.207405 --- ParallelTerminationStrategy: PID 11161 died... 17:35:06.226460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11161): Terminated: ok {rc=0} 17:35:06.270660 --- ParallelTerminationStrategy: PID 11164 died... 17:35:06.289564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11164): Terminated: ok {rc=0} 17:35:06.375327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:35:07.528693 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:07.541115 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:07.614400 tst iperf3m4.py: using LAC 35167 17:35:07.749849 tst iperf3m4.py: using RAC 232 17:35:07.880359 tst iperf3m4.py: using CellId 35167 17:35:08.009365 tst iperf3m4.py: using BVCI 35168 17:35:08.130073 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.141486 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.152549 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.164230 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.175758 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.187317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.198998 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.210535 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:08.222219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:08.346016 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:08.468038 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:08.591803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:08.712883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:35:08.922189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:09.235430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11166): Launched 17:35:09.508535 run iperf3-srv_10.42.42.10(pid=11167): Launched 17:35:09.625842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:35:09.834497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:10.147212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11168): Launched 17:35:10.421485 run iperf3-srv_10.42.42.10(pid=11169): Launched 17:35:10.538637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:35:10.748764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:11.062779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11170): Launched 17:35:11.336061 run iperf3-srv_10.42.42.10(pid=11171): Launched 17:35:11.453130 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:35:11.661392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:11.974706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11172): Launched 17:35:12.248833 run iperf3-srv_10.42.42.10(pid=11173): Launched 17:35:12.365560 tst iperf3m4.py:8: start network... 17:35:12.574696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:13.055559 run create_hlr_db(pid=11174): Launched 17:35:13.184600 bus /gobi_6: Setting Powered False 17:35:14.246833 run create_hlr_db(pid=11174): Terminated: ok {rc=0} 17:35:14.682539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Launched 17:35:14.993538 run osmo-hlr_10.42.42.2(pid=11177): Launched 17:35:15.111190 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:15.648934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Launched 17:35:15.971423 run osmo-stp_10.42.42.5(pid=11180): Launched 17:35:16.210705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:16.895054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11182): Launched 17:35:17.027814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:17.296342 run patchelf(pid=11183): Launched 17:35:17.484798 run osmo-stp_10.42.42.5(pid=11180): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] 17:35:17.616940 run osmo-stp_10.42.42.5(pid=11180): stdout: | (launched: 2022-12-13_17:35:15.913914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:17.750627 run osmo-stp_10.42.42.5(pid=11180): stderr: | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173516235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:17.884127 run osmo-stp_10.42.42.5(pid=11180): stdout: | (launched: 2022-12-13_17:35:15.913914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:18.011613 run osmo-stp_10.42.42.5(pid=11180): stderr: | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173516235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173516235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173516236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:18.162406 run patchelf(pid=11183): Terminating (SIGINT) 17:35:18.340858 run patchelf(pid=11183): Terminated: ok {rc=0} 17:35:18.469877 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11180): Process ended prematurely: osmo-stp_10.42.42.5(pid=11180) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:35:18.479542 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:35:18.507297 run osmo-hlr_10.42.42.2(pid=11177): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11177)] 17:35:18.555765 run osmo-hlr_10.42.42.2(pid=11177): stdout: | (launched: 2022-12-13_17:35:14.936560) 17:35:18.605869 run osmo-hlr_10.42.42.2(pid=11177): stderr: | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173515112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173515127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173515138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173515138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173515138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:18.656432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11166): Terminating (SIGTERM) 17:35:18.697019 run iperf3-srv_10.42.42.10(pid=11167): Terminating (SIGTERM) 17:35:18.737353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11168): Terminating (SIGTERM) 17:35:18.777865 run iperf3-srv_10.42.42.10(pid=11169): Terminating (SIGTERM) 17:35:18.818209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11170): Terminating (SIGTERM) 17:35:18.858702 run iperf3-srv_10.42.42.10(pid=11171): Terminating (SIGTERM) 17:35:18.899007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11172): Terminating (SIGTERM) 17:35:18.939317 run iperf3-srv_10.42.42.10(pid=11173): Terminating (SIGTERM) 17:35:18.979524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminating (SIGTERM) 17:35:19.019886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Terminating (SIGTERM) 17:35:19.060141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11182): Terminating (SIGTERM) 17:35:19.100790 --- ParallelTerminationStrategy: PID 11166 died... 17:35:19.120498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11166): Terminated: ok {rc=0} 17:35:19.165518 --- ParallelTerminationStrategy: PID 11167 died... 17:35:19.184503 run iperf3-srv_10.42.42.10(pid=11167): Terminated {rc=256} 17:35:19.229234 --- ParallelTerminationStrategy: PID 11168 died... 17:35:19.248063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11168): Terminated: ok {rc=0} 17:35:19.293070 --- ParallelTerminationStrategy: PID 11169 died... 17:35:19.312429 run iperf3-srv_10.42.42.10(pid=11169): Terminated {rc=256} 17:35:19.357145 --- ParallelTerminationStrategy: PID 11170 died... 17:35:19.376064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11170): Terminated: ok {rc=0} 17:35:19.421414 --- ParallelTerminationStrategy: PID 11171 died... 17:35:19.440223 run iperf3-srv_10.42.42.10(pid=11171): Terminated {rc=256} 17:35:19.485104 --- ParallelTerminationStrategy: PID 11172 died... 17:35:19.504229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11172): Terminated: ok {rc=0} 17:35:19.549140 --- ParallelTerminationStrategy: PID 11173 died... 17:35:19.568067 run iperf3-srv_10.42.42.10(pid=11173): Terminated {rc=256} 17:35:19.612732 --- ParallelTerminationStrategy: PID 11176 died... 17:35:19.631868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminated: ok {rc=0} 17:35:19.676628 --- ParallelTerminationStrategy: PID 11179 died... 17:35:19.695727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Terminated: ok {rc=0} 17:35:19.740330 --- ParallelTerminationStrategy: PID 11182 died... 17:35:19.759424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11182): Terminated: ok {rc=0} 17:35:19.847310 bus /gobi_4: Setting Powered False 17:35:20.951705 bus /gobi_4: Setting Powered False 17:35:22.072602 bus /gobi_1: Setting Powered False 17:35:23.174007 bus /gobi_1: Setting Powered False 17:35:24.294835 bus /gobi_0: Setting Powered False 17:35:25.398986 bus /gobi_0: Setting Powered False 17:35:26.519242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:35:27.623606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:27.636016 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:27.709577 tst ping.py: using LAC 35168 17:35:27.839205 tst ping.py: using RAC 233 17:35:27.969767 tst ping.py: using CellId 35168 17:35:28.097403 tst ping.py: using BVCI 35169 17:35:28.216274 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.227977 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.239215 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.250521 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.262033 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.273882 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.285737 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:28.297459 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:28.419949 tst ping.py:19: start network... 17:35:28.641775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:29.146810 run create_hlr_db(pid=11184): Launched 17:35:29.274070 bus /gobi_6: Setting Powered False 17:35:30.339198 run create_hlr_db(pid=11184): Terminated: ok {rc=0} 17:35:30.797028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11186): Launched 17:35:31.145697 run osmo-hlr_10.42.42.2(pid=11187): Launched 17:35:31.332531 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:32.107018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11189): Launched 17:35:32.481112 run osmo-stp_10.42.42.5(pid=11190): Launched 17:35:32.607208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:33.172688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11192): Launched 17:35:33.299033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:33.577777 run patchelf(pid=11193): Launched 17:35:33.760666 run osmo-stp_10.42.42.5(pid=11190): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11190)] 17:35:33.900118 run osmo-stp_10.42.42.5(pid=11190): stdout: | (launched: 2022-12-13_17:35:32.421515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:34.041596 run osmo-stp_10.42.42.5(pid=11190): stderr: | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173532612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:34.184130 run osmo-stp_10.42.42.5(pid=11190): stdout: | (launched: 2022-12-13_17:35:32.421515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:34.319799 run osmo-stp_10.42.42.5(pid=11190): stderr: | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173532611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173532612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173532612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:34.480019 run patchelf(pid=11193): Terminating (SIGINT) 17:35:34.667027 run patchelf(pid=11193): Terminated: ok {rc=0} 17:35:34.801231 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11190): Process ended prematurely: osmo-stp_10.42.42.5(pid=11190) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11190)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 17:35:34.810959 tst ping.py:22: Test FAILED (7.2 sec) 17:35:34.839388 run osmo-hlr_10.42.42.2(pid=11187): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11187)] 17:35:34.892443 run osmo-hlr_10.42.42.2(pid=11187): stdout: | (launched: 2022-12-13_17:35:31.086747) 17:35:34.946341 run osmo-hlr_10.42.42.2(pid=11187): stderr: | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173531485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173531507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173531527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173531527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173531527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:35.000671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11186): Terminating (SIGTERM) 17:35:35.043420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11189): Terminating (SIGTERM) 17:35:35.086762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11192): Terminating (SIGTERM) 17:35:35.130318 --- ParallelTerminationStrategy: PID 11186 died... 17:35:35.151420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11186): Terminated: ok {rc=0} 17:35:35.199695 --- ParallelTerminationStrategy: PID 11189 died... 17:35:35.220269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11189): Terminated: ok {rc=0} 17:35:35.267914 --- ParallelTerminationStrategy: PID 11192 died... 17:35:35.288443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11192): Terminated: ok {rc=0} 17:35:35.379760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:35:36.469112 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:36.481393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:36.554852 tst ping_idle_ping.py: using LAC 35169 17:35:36.684681 tst ping_idle_ping.py: using RAC 234 17:35:36.816076 tst ping_idle_ping.py: using CellId 35169 17:35:36.944552 tst ping_idle_ping.py: using BVCI 35170 17:35:37.064164 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.075876 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.087267 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.098710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.110471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.122216 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.134051 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:37.146043 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:37.268677 tst ping_idle_ping.py:24: start network... 17:35:37.491323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:38.006775 run create_hlr_db(pid=11194): Launched 17:35:38.132654 bus /gobi_6: Setting Powered False 17:35:39.198337 run create_hlr_db(pid=11194): Terminated: ok {rc=0} 17:35:39.637298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11196): Launched 17:35:39.944048 run osmo-hlr_10.42.42.2(pid=11197): Launched 17:35:40.061504 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:40.589596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11199): Launched 17:35:40.896729 run osmo-stp_10.42.42.5(pid=11200): Launched 17:35:41.013342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:41.544176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11202): Launched 17:35:41.662099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:41.929768 run patchelf(pid=11203): Launched 17:35:42.118972 run osmo-stp_10.42.42.5(pid=11200): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11200)] 17:35:42.259795 run osmo-stp_10.42.42.5(pid=11200): stdout: | (launched: 2022-12-13_17:35:40.840437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:42.401798 run osmo-stp_10.42.42.5(pid=11200): stderr: | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173541011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:42.543718 run osmo-stp_10.42.42.5(pid=11200): stdout: | (launched: 2022-12-13_17:35:40.840437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:42.679002 run osmo-stp_10.42.42.5(pid=11200): stderr: | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173541010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173541011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173541011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:42.839204 run patchelf(pid=11203): Terminating (SIGINT) 17:35:43.025342 run patchelf(pid=11203): Terminated: ok {rc=0} 17:35:43.159736 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11200): Process ended prematurely: osmo-stp_10.42.42.5(pid=11200) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11200)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:35:43.169520 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:35:43.198568 run osmo-hlr_10.42.42.2(pid=11197): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11197)] 17:35:43.251353 run osmo-hlr_10.42.42.2(pid=11197): stdout: | (launched: 2022-12-13_17:35:39.887799) 17:35:43.305408 run osmo-hlr_10.42.42.2(pid=11197): stderr: | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173540061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173540073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173540082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173540082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173540082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:43.359340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11196): Terminating (SIGTERM) 17:35:43.402538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11199): Terminating (SIGTERM) 17:35:43.446233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11202): Terminating (SIGTERM) 17:35:43.490239 --- ParallelTerminationStrategy: PID 11196 died... 17:35:43.511288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11196): Terminated: ok {rc=0} 17:35:43.559436 --- ParallelTerminationStrategy: PID 11199 died... 17:35:43.579935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11199): Terminated: ok {rc=0} 17:35:43.627713 --- ParallelTerminationStrategy: PID 11202 died... 17:35:43.648437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11202): Terminated: ok {rc=0} 17:35:43.739628 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:35:45.048773 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:35:45.055469 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:35:45.090127 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:35:45.130631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:35:45.224808 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:35:45.259092 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:35:45.298775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:35:45.900903 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:35:45.953432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:45.965309 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:46.035903 tst cs_paging_gprs_active.py: using LAC 35170 17:35:46.162608 tst cs_paging_gprs_active.py: using RAC 235 17:35:46.324477 tst cs_paging_gprs_active.py: using CellId 35170 17:35:46.462740 tst cs_paging_gprs_active.py: using BVCI 35171 17:35:46.593689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.606393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.619043 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.631668 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.645328 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.658067 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.670936 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.686803 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.702653 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:46.850436 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:46.976301 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:35:47.193511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:47.512581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11208): Launched 17:35:47.786442 run iperf3-srv_10.42.42.10(pid=11211): Launched 17:35:47.905635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:35:48.115230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:48.429369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11212): Launched 17:35:48.703717 run iperf3-srv_10.42.42.10(pid=11213): Launched 17:35:48.830512 tst cs_paging_gprs_active.py:38: start network... 17:35:49.056792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:49.575632 run create_hlr_db(pid=11214): Launched 17:35:49.703562 bus /gobi_6: Setting Powered False 17:35:50.769928 run create_hlr_db(pid=11214): Terminated: ok {rc=0} 17:35:51.221369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11216): Launched 17:35:51.534914 run osmo-hlr_10.42.42.2(pid=11217): Launched 17:35:51.654628 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:52.199378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11219): Launched 17:35:52.511572 run osmo-stp_10.42.42.5(pid=11220): Launched 17:35:52.630164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:53.167170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11222): Launched 17:35:53.287341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:53.551618 run patchelf(pid=11223): Launched 17:35:53.725935 run osmo-stp_10.42.42.5(pid=11220): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11220)] 17:35:53.858527 run osmo-stp_10.42.42.5(pid=11220): stdout: | (launched: 2022-12-13_17:35:52.454534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:53.992522 run osmo-stp_10.42.42.5(pid=11220): stderr: | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173552622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:54.126521 run osmo-stp_10.42.42.5(pid=11220): stdout: | (launched: 2022-12-13_17:35:52.454534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:54.254192 run osmo-stp_10.42.42.5(pid=11220): stderr: | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173552621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173552622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173552622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:54.405541 run patchelf(pid=11223): Terminating (SIGINT) 17:35:54.582735 run patchelf(pid=11223): Terminated: ok {rc=0} 17:35:54.710663 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11220): Process ended prematurely: osmo-stp_10.42.42.5(pid=11220) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11220)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:35:54.720164 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:35:54.747781 run osmo-hlr_10.42.42.2(pid=11217): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11217)] 17:35:54.795975 run osmo-hlr_10.42.42.2(pid=11217): stdout: | (launched: 2022-12-13_17:35:51.477273) 17:35:54.845864 run osmo-hlr_10.42.42.2(pid=11217): stderr: | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173551652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173551664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173551672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173551673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173551673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:54.896204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11208): Terminating (SIGTERM) 17:35:54.936378 run iperf3-srv_10.42.42.10(pid=11211): Terminating (SIGTERM) 17:35:54.976300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11212): Terminating (SIGTERM) 17:35:55.016292 run iperf3-srv_10.42.42.10(pid=11213): Terminating (SIGTERM) 17:35:55.056255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11216): Terminating (SIGTERM) 17:35:55.096234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11219): Terminating (SIGTERM) 17:35:55.136184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11222): Terminating (SIGTERM) 17:35:55.176226 --- ParallelTerminationStrategy: PID 11208 died... 17:35:55.195632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11208): Terminated: ok {rc=0} 17:35:55.239834 --- ParallelTerminationStrategy: PID 11211 died... 17:35:55.258568 run iperf3-srv_10.42.42.10(pid=11211): Terminated {rc=256} 17:35:55.302743 --- ParallelTerminationStrategy: PID 11212 died... 17:35:55.321548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11212): Terminated: ok {rc=0} 17:35:55.365610 --- ParallelTerminationStrategy: PID 11213 died... 17:35:55.384261 run iperf3-srv_10.42.42.10(pid=11213): Terminated {rc=256} 17:35:55.428208 --- ParallelTerminationStrategy: PID 11216 died... 17:35:55.446978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11216): Terminated: ok {rc=0} 17:35:55.491131 --- ParallelTerminationStrategy: PID 11219 died... 17:35:55.509915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11219): Terminated: ok {rc=0} 17:35:55.553927 --- ParallelTerminationStrategy: PID 11222 died... 17:35:55.572719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11222): Terminated: ok {rc=0} 17:35:55.659789 bus /gobi_0: Setting Powered False 17:35:56.761897 bus /gobi_0: Setting Powered False 17:35:57.880494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:35:59.034523 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.046832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:59.122270 tst iperf3.py: using LAC 35171 17:35:59.254324 tst iperf3.py: using RAC 236 17:35:59.385364 tst iperf3.py: using CellId 35171 17:35:59.518886 tst iperf3.py: using BVCI 35172 17:35:59.641145 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.652555 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.663899 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.675311 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.686955 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.698704 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.710329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.721979 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:59.733911 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:59.854433 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:00.064197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:00.377841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Launched 17:36:00.650633 run iperf3-srv_10.42.42.10(pid=11225): Launched 17:36:00.770243 tst iperf3.py:8: start network... 17:36:00.983793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:01.474964 run create_hlr_db(pid=11226): Launched 17:36:01.638923 bus /gobi_6: Setting Powered False 17:36:02.700855 run create_hlr_db(pid=11226): Terminated: ok {rc=0} 17:36:03.171514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Launched 17:36:03.508815 run osmo-hlr_10.42.42.2(pid=11229): Launched 17:36:03.637050 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:04.214595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Launched 17:36:04.548134 run osmo-stp_10.42.42.5(pid=11232): Launched 17:36:04.675226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:05.248483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Launched 17:36:05.376720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:05.658999 run patchelf(pid=11235): Launched 17:36:05.844502 run osmo-stp_10.42.42.5(pid=11232): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] 17:36:05.986202 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-13_17:36:04.487688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:06.129467 run osmo-stp_10.42.42.5(pid=11232): stderr: | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173604678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:06.273182 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-13_17:36:04.487688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:06.409579 run osmo-stp_10.42.42.5(pid=11232): stderr: | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173604677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173604678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173604678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:06.571225 run patchelf(pid=11235): Terminating (SIGINT) 17:36:06.760069 run patchelf(pid=11235): Terminated: ok {rc=0} 17:36:06.896837 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 17:36:06.907134 tst iperf3.py:8: Test FAILED (7.9 sec) 17:36:06.936143 run osmo-hlr_10.42.42.2(pid=11229): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11229)] 17:36:06.987754 run osmo-hlr_10.42.42.2(pid=11229): stdout: | (launched: 2022-12-13_17:36:03.447961) 17:36:07.041148 run osmo-hlr_10.42.42.2(pid=11229): stderr: | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173603643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173603655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173603664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173603664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173603664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:07.094451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Terminating (SIGTERM) 17:36:07.137655 run iperf3-srv_10.42.42.10(pid=11225): Terminating (SIGTERM) 17:36:07.180870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminating (SIGTERM) 17:36:07.224423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminating (SIGTERM) 17:36:07.267724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Terminating (SIGTERM) 17:36:07.311211 --- ParallelTerminationStrategy: PID 11224 died... 17:36:07.332147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Terminated: ok {rc=0} 17:36:07.379650 --- ParallelTerminationStrategy: PID 11225 died... 17:36:07.399747 run iperf3-srv_10.42.42.10(pid=11225): Terminated {rc=256} 17:36:07.447449 --- ParallelTerminationStrategy: PID 11228 died... 17:36:07.467945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminated: ok {rc=0} 17:36:07.515278 --- ParallelTerminationStrategy: PID 11231 died... 17:36:07.535616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminated: ok {rc=0} 17:36:07.582843 --- ParallelTerminationStrategy: PID 11234 died... 17:36:07.603228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Terminated: ok {rc=0} 17:36:07.693971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:36:08.847762 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:08.860159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:08.933318 tst iperf3m4.py: using LAC 35172 17:36:09.064046 tst iperf3m4.py: using RAC 237 17:36:09.195333 tst iperf3m4.py: using CellId 35172 17:36:09.331482 tst iperf3m4.py: using BVCI 35173 17:36:09.454013 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.465643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.476919 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.488667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.500261 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.512456 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.524485 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.536072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:09.547804 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:09.668736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:09.795132 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:09.915793 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:10.040110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:10.249733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:10.562890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11236): Launched 17:36:10.834798 run iperf3-srv_10.42.42.10(pid=11237): Launched 17:36:10.951754 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:36:11.159487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:11.471704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11238): Launched 17:36:11.743624 run iperf3-srv_10.42.42.10(pid=11239): Launched 17:36:11.859726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:36:12.067131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:12.379324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11240): Launched 17:36:12.652198 run iperf3-srv_10.42.42.10(pid=11241): Launched 17:36:12.769367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:36:12.977814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:13.289780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11242): Launched 17:36:13.561206 run iperf3-srv_10.42.42.10(pid=11243): Launched 17:36:13.677357 tst iperf3m4.py:8: start network... 17:36:13.884452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:14.364668 run create_hlr_db(pid=11244): Launched 17:36:14.494672 bus /gobi_6: Setting Powered False 17:36:15.560214 run create_hlr_db(pid=11244): Terminated: ok {rc=0} 17:36:16.022221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Launched 17:36:16.390929 run osmo-hlr_10.42.42.2(pid=11247): Launched 17:36:16.680766 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:17.400024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Launched 17:36:17.724560 run osmo-stp_10.42.42.5(pid=11250): Launched 17:36:17.842899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:18.379517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Launched 17:36:18.498754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:18.762557 run patchelf(pid=11253): Launched 17:36:18.936536 run osmo-stp_10.42.42.5(pid=11250): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] 17:36:19.069315 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-13_17:36:17.666860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:19.203038 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173617837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:19.337436 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-13_17:36:17.666860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:19.465176 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173617836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173617837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173617837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:19.616856 run patchelf(pid=11253): Terminating (SIGINT) 17:36:19.794940 run patchelf(pid=11253): Terminated: ok {rc=0} 17:36:19.922083 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:36:19.931548 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:36:19.959144 run osmo-hlr_10.42.42.2(pid=11247): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11247)] 17:36:20.007377 run osmo-hlr_10.42.42.2(pid=11247): stdout: | (launched: 2022-12-13_17:36:16.306701) 17:36:20.057403 run osmo-hlr_10.42.42.2(pid=11247): stderr: | [0;m[1;31m20221213173616671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173616671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173616671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173616671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173616672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173616672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173616697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173616713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173616714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173616714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:20.107990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11236): Terminating (SIGTERM) 17:36:20.148432 run iperf3-srv_10.42.42.10(pid=11237): Terminating (SIGTERM) 17:36:20.188681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11238): Terminating (SIGTERM) 17:36:20.229094 run iperf3-srv_10.42.42.10(pid=11239): Terminating (SIGTERM) 17:36:20.269379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11240): Terminating (SIGTERM) 17:36:20.309551 run iperf3-srv_10.42.42.10(pid=11241): Terminating (SIGTERM) 17:36:20.349704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11242): Terminating (SIGTERM) 17:36:20.389692 run iperf3-srv_10.42.42.10(pid=11243): Terminating (SIGTERM) 17:36:20.429744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminating (SIGTERM) 17:36:20.470098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminating (SIGTERM) 17:36:20.510275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Terminating (SIGTERM) 17:36:20.550774 --- ParallelTerminationStrategy: PID 11236 died... 17:36:20.570539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11236): Terminated: ok {rc=0} 17:36:20.615459 --- ParallelTerminationStrategy: PID 11237 died... 17:36:20.634378 run iperf3-srv_10.42.42.10(pid=11237): Terminated {rc=256} 17:36:20.679198 --- ParallelTerminationStrategy: PID 11238 died... 17:36:20.698349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11238): Terminated: ok {rc=0} 17:36:20.743155 --- ParallelTerminationStrategy: PID 11239 died... 17:36:20.762028 run iperf3-srv_10.42.42.10(pid=11239): Terminated {rc=256} 17:36:20.806633 --- ParallelTerminationStrategy: PID 11240 died... 17:36:20.825825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11240): Terminated: ok {rc=0} 17:36:20.870263 --- ParallelTerminationStrategy: PID 11241 died... 17:36:20.889303 run iperf3-srv_10.42.42.10(pid=11241): Terminated {rc=256} 17:36:20.933873 --- ParallelTerminationStrategy: PID 11242 died... 17:36:20.953372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11242): Terminated: ok {rc=0} 17:36:20.998302 --- ParallelTerminationStrategy: PID 11243 died... 17:36:21.017491 run iperf3-srv_10.42.42.10(pid=11243): Terminated {rc=256} 17:36:21.062436 --- ParallelTerminationStrategy: PID 11246 died... 17:36:21.081570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminated: ok {rc=0} 17:36:21.126302 --- ParallelTerminationStrategy: PID 11249 died... 17:36:21.145346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminated: ok {rc=0} 17:36:21.190068 --- ParallelTerminationStrategy: PID 11252 died... 17:36:21.209119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Terminated: ok {rc=0} 17:36:21.295659 bus /gobi_4: Setting Powered False 17:36:22.398095 bus /gobi_4: Setting Powered False 17:36:23.516130 bus /gobi_1: Setting Powered False 17:36:24.613867 bus /gobi_1: Setting Powered False 17:36:25.730585 bus /gobi_0: Setting Powered False 17:36:26.831170 bus /gobi_0: Setting Powered False 17:36:27.949520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:36:29.055921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.068203 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:29.143662 tst ping.py: using LAC 35173 17:36:29.276705 tst ping.py: using RAC 238 17:36:29.406530 tst ping.py: using CellId 35173 17:36:29.537389 tst ping.py: using BVCI 35174 17:36:29.658842 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.670471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.681865 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.693225 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.705188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.717192 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.729461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:29.741635 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:29.863250 tst ping.py:19: start network... 17:36:30.068368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:30.540341 run create_hlr_db(pid=11254): Launched 17:36:30.665486 bus /gobi_6: Setting Powered False 17:36:31.730035 run create_hlr_db(pid=11254): Terminated: ok {rc=0} 17:36:32.220612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Launched 17:36:32.538732 run osmo-hlr_10.42.42.2(pid=11257): Launched 17:36:32.656852 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:33.192471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Launched 17:36:33.499183 run osmo-stp_10.42.42.5(pid=11260): Launched 17:36:33.616053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:34.145819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Launched 17:36:34.263145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:34.522899 run patchelf(pid=11263): Launched 17:36:34.694219 run osmo-stp_10.42.42.5(pid=11260): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] 17:36:34.823564 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-13_17:36:33.442419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:34.954913 run osmo-stp_10.42.42.5(pid=11260): stderr: | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173633613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:35.087175 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-13_17:36:33.442419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:35.212380 run osmo-stp_10.42.42.5(pid=11260): stderr: | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173633612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173633613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173633613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:35.360657 run patchelf(pid=11263): Terminating (SIGINT) 17:36:35.533972 run patchelf(pid=11263): Terminated: ok {rc=0} 17:36:35.658646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 17:36:35.667555 tst ping.py:22: Test FAILED (6.6 sec) 17:36:35.694539 run osmo-hlr_10.42.42.2(pid=11257): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11257)] 17:36:35.742989 run osmo-hlr_10.42.42.2(pid=11257): stdout: | (launched: 2022-12-13_17:36:32.482111) 17:36:35.793543 run osmo-hlr_10.42.42.2(pid=11257): stderr: | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173632656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173632668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173632676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173632677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173632677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:35.844155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminating (SIGTERM) 17:36:35.884620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminating (SIGTERM) 17:36:35.925107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Terminating (SIGTERM) 17:36:35.966434 --- ParallelTerminationStrategy: PID 11256 died... 17:36:35.986223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminated: ok {rc=0} 17:36:36.031006 --- ParallelTerminationStrategy: PID 11259 died... 17:36:36.050084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminated: ok {rc=0} 17:36:36.094643 --- ParallelTerminationStrategy: PID 11262 died... 17:36:36.113798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Terminated: ok {rc=0} 17:36:36.201326 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:36:37.292669 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.304861 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:37.377329 tst ping_idle_ping.py: using LAC 35174 17:36:37.499222 tst ping_idle_ping.py: using RAC 239 17:36:37.621448 tst ping_idle_ping.py: using CellId 35174 17:36:37.743926 tst ping_idle_ping.py: using BVCI 35175 17:36:37.857369 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.868382 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.879218 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.890084 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.900632 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.911371 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.922727 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:37.933631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:38.056791 tst ping_idle_ping.py:24: start network... 17:36:38.280557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:38.792276 run create_hlr_db(pid=11265): Launched 17:36:38.917264 bus /gobi_6: Setting Powered False 17:36:39.982360 run create_hlr_db(pid=11265): Terminated: ok {rc=0} 17:36:40.423255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Launched 17:36:40.729632 run osmo-hlr_10.42.42.2(pid=11268): Launched 17:36:40.846699 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:41.390007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Launched 17:36:41.696251 run osmo-stp_10.42.42.5(pid=11271): Launched 17:36:41.812734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:42.342980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11273): Launched 17:36:42.460584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:42.719348 run patchelf(pid=11274): Launched 17:36:42.890871 run osmo-stp_10.42.42.5(pid=11271): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] 17:36:43.020102 run osmo-stp_10.42.42.5(pid=11271): stdout: | (launched: 2022-12-13_17:36:41.639726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:43.152225 run osmo-stp_10.42.42.5(pid=11271): stderr: | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173641808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:43.283684 run osmo-stp_10.42.42.5(pid=11271): stdout: | (launched: 2022-12-13_17:36:41.639726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:43.408535 run osmo-stp_10.42.42.5(pid=11271): stderr: | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173641807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173641808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173641808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:43.556703 run patchelf(pid=11274): Terminating (SIGINT) 17:36:43.730334 run patchelf(pid=11274): Terminated: ok {rc=0} 17:36:43.855107 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11271): Process ended prematurely: osmo-stp_10.42.42.5(pid=11271) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:36:43.863954 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:36:43.890753 run osmo-hlr_10.42.42.2(pid=11268): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11268)] 17:36:43.939217 run osmo-hlr_10.42.42.2(pid=11268): stdout: | (launched: 2022-12-13_17:36:40.673383) 17:36:43.989329 run osmo-hlr_10.42.42.2(pid=11268): stderr: | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173640847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173640860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173640868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173640868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173640868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:44.039532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Terminating (SIGTERM) 17:36:44.079629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Terminating (SIGTERM) 17:36:44.119893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11273): Terminating (SIGTERM) 17:36:44.160197 --- ParallelTerminationStrategy: PID 11267 died... 17:36:44.179737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Terminated: ok {rc=0} 17:36:44.224237 --- ParallelTerminationStrategy: PID 11270 died... 17:36:44.243356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Terminated: ok {rc=0} 17:36:44.287579 --- ParallelTerminationStrategy: PID 11273 died... 17:36:44.306621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11273): Terminated: ok {rc=0} 17:36:44.391202 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:36:45.702377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:36:45.709906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:36:45.745747 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:36:45.785808 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:36:45.894157 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:36:45.931028 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:36:45.971395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:36:46.611903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:36:46.680499 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.697085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:46.767094 tst cs_paging_gprs_active.py: using LAC 35175 17:36:46.903556 tst cs_paging_gprs_active.py: using RAC 240 17:36:47.058356 tst cs_paging_gprs_active.py: using CellId 35175 17:36:47.183984 tst cs_paging_gprs_active.py: using BVCI 35176 17:36:47.318298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.330279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.342079 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.354030 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.366013 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.377903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.390173 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.402445 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:47.414454 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:47.540797 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:47.665522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:36:47.891820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:48.229058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Launched 17:36:48.521898 run iperf3-srv_10.42.42.10(pid=11279): Launched 17:36:48.647819 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:36:48.875223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:49.212594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Launched 17:36:49.507169 run iperf3-srv_10.42.42.10(pid=11281): Launched 17:36:49.632577 tst cs_paging_gprs_active.py:38: start network... 17:36:49.858586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:50.377772 run create_hlr_db(pid=11282): Launched 17:36:50.506755 bus /gobi_6: Setting Powered False 17:36:51.571700 run create_hlr_db(pid=11282): Terminated: ok {rc=0} 17:36:52.018666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11284): Launched 17:36:52.331258 run osmo-hlr_10.42.42.2(pid=11285): Launched 17:36:52.450691 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:52.988488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11287): Launched 17:36:53.302910 run osmo-stp_10.42.42.5(pid=11288): Launched 17:36:53.422219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:53.960051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11290): Launched 17:36:54.079920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:54.344682 run patchelf(pid=11291): Launched 17:36:54.518718 run osmo-stp_10.42.42.5(pid=11288): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11288)] 17:36:54.651109 run osmo-stp_10.42.42.5(pid=11288): stdout: | (launched: 2022-12-13_17:36:53.244666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:54.785144 run osmo-stp_10.42.42.5(pid=11288): stderr: | [0;m[38;5;43m20221213173653413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173653414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173653414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173653414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:54.919248 run osmo-stp_10.42.42.5(pid=11288): stdout: | (launched: 2022-12-13_17:36:53.244666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:55.046934 run osmo-stp_10.42.42.5(pid=11288): stderr: | [0;m[38;5;43m20221213173653413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173653414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173653414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173653414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173653415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:55.198801 run patchelf(pid=11291): Terminating (SIGINT) 17:36:55.376772 run patchelf(pid=11291): Terminated: ok {rc=0} 17:36:55.504182 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11288): Process ended prematurely: osmo-stp_10.42.42.5(pid=11288) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11288)] [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:36:55.513776 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:36:55.541279 run osmo-hlr_10.42.42.2(pid=11285): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11285)] 17:36:55.589639 run osmo-hlr_10.42.42.2(pid=11285): stdout: | (launched: 2022-12-13_17:36:52.274006) 17:36:55.639588 run osmo-hlr_10.42.42.2(pid=11285): stderr: | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173652451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173652463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173652471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173652472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173652472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:55.690140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Terminating (SIGTERM) 17:36:55.730756 run iperf3-srv_10.42.42.10(pid=11279): Terminating (SIGTERM) 17:36:55.771350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Terminating (SIGTERM) 17:36:55.811912 run iperf3-srv_10.42.42.10(pid=11281): Terminating (SIGTERM) 17:36:55.852336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11284): Terminating (SIGTERM) 17:36:55.892835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11287): Terminating (SIGTERM) 17:36:55.933303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11290): Terminating (SIGTERM) 17:36:55.974074 --- ParallelTerminationStrategy: PID 11278 died... 17:36:55.993554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Terminated: ok {rc=0} 17:36:56.038275 --- ParallelTerminationStrategy: PID 11279 died... 17:36:56.057131 run iperf3-srv_10.42.42.10(pid=11279): Terminated {rc=256} 17:36:56.101682 --- ParallelTerminationStrategy: PID 11280 died... 17:36:56.120615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Terminated: ok {rc=0} 17:36:56.165475 --- ParallelTerminationStrategy: PID 11281 died... 17:36:56.184343 run iperf3-srv_10.42.42.10(pid=11281): Terminated {rc=256} 17:36:56.229044 --- ParallelTerminationStrategy: PID 11284 died... 17:36:56.247990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11284): Terminated: ok {rc=0} 17:36:56.292692 --- ParallelTerminationStrategy: PID 11287 died... 17:36:56.311781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11287): Terminated: ok {rc=0} 17:36:56.356472 --- ParallelTerminationStrategy: PID 11290 died... 17:36:56.375567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11290): Terminated: ok {rc=0} 17:36:56.462629 bus /gobi_0: Setting Powered False 17:36:57.564298 bus /gobi_0: Setting Powered False 17:36:58.683307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:36:59.837585 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:59.850078 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:59.907386 tst iperf3.py: using LAC 35176 17:37:00.041229 tst iperf3.py: using RAC 241 17:37:00.173203 tst iperf3.py: using CellId 35176 17:37:00.304342 tst iperf3.py: using BVCI 35177 17:37:00.419457 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.430826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.442094 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.453153 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.464190 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.475228 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.486437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.497523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:00.508745 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:00.627468 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:37:00.838736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:01.170217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11292): Launched 17:37:01.463485 run iperf3-srv_10.42.42.10(pid=11293): Launched 17:37:01.608660 tst iperf3.py:8: start network... 17:37:01.846355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:02.377492 run create_hlr_db(pid=11294): Launched 17:37:02.506853 bus /gobi_6: Setting Powered False 17:37:03.572312 run create_hlr_db(pid=11294): Terminated: ok {rc=0} 17:37:04.020067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Launched 17:37:04.333289 run osmo-hlr_10.42.42.2(pid=11297): Launched 17:37:04.453061 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:04.990891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Launched 17:37:05.304554 run osmo-stp_10.42.42.5(pid=11300): Launched 17:37:05.424791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:05.963131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11302): Launched 17:37:06.082976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:06.347566 run patchelf(pid=11303): Launched 17:37:06.521407 run osmo-stp_10.42.42.5(pid=11300): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] 17:37:06.653806 run osmo-stp_10.42.42.5(pid=11300): stdout: | (launched: 2022-12-13_17:37:05.246557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:06.787733 run osmo-stp_10.42.42.5(pid=11300): stderr: | [0;m[38;5;43m20221213173705415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173705415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173705416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173705416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:06.921859 run osmo-stp_10.42.42.5(pid=11300): stdout: | (launched: 2022-12-13_17:37:05.246557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:07.049241 run osmo-stp_10.42.42.5(pid=11300): stderr: | [0;m[38;5;43m20221213173705415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173705415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173705416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173705416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173705417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:07.200043 run patchelf(pid=11303): Terminating (SIGINT) 17:37:07.378864 run patchelf(pid=11303): Terminated: ok {rc=0} 17:37:07.506717 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11300): Process ended prematurely: osmo-stp_10.42.42.5(pid=11300) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:37:07.516167 tst iperf3.py:8: Test FAILED (7.7 sec) 17:37:07.543782 run osmo-hlr_10.42.42.2(pid=11297): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11297)] 17:37:07.592228 run osmo-hlr_10.42.42.2(pid=11297): stdout: | (launched: 2022-12-13_17:37:04.275711) 17:37:07.642528 run osmo-hlr_10.42.42.2(pid=11297): stderr: | [0;m[1;31m20221213173704452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173704452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173704452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173704453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173704453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173704453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173704467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173704476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173704476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173704476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:07.693292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11292): Terminating (SIGTERM) 17:37:07.733678 run iperf3-srv_10.42.42.10(pid=11293): Terminating (SIGTERM) 17:37:07.774125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Terminating (SIGTERM) 17:37:07.814562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Terminating (SIGTERM) 17:37:07.855101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11302): Terminating (SIGTERM) 17:37:07.895779 --- ParallelTerminationStrategy: PID 11292 died... 17:37:07.915193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11292): Terminated: ok {rc=0} 17:37:07.959924 --- ParallelTerminationStrategy: PID 11293 died... 17:37:07.978781 run iperf3-srv_10.42.42.10(pid=11293): Terminated {rc=256} 17:37:08.023239 --- ParallelTerminationStrategy: PID 11296 died... 17:37:08.042215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Terminated: ok {rc=0} 17:37:08.086976 --- ParallelTerminationStrategy: PID 11299 died... 17:37:08.106057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Terminated: ok {rc=0} 17:37:08.150678 --- ParallelTerminationStrategy: PID 11302 died... 17:37:08.169743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11302): Terminated: ok {rc=0} 17:37:08.257049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:37:09.407314 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:09.419196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:09.474124 tst iperf3m4.py: using LAC 35177 17:37:09.596808 tst iperf3m4.py: using RAC 242 17:37:09.721344 tst iperf3m4.py: using CellId 35177 17:37:09.845549 tst iperf3m4.py: using BVCI 35178 17:37:09.959917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:09.971265 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:09.982374 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:09.993570 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:10.004681 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:10.015777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:10.026989 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:10.038039 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:10.049262 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:10.171484 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:10.293697 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:10.416377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:10.537715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:37:10.747833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:11.062129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Launched 17:37:11.336824 run iperf3-srv_10.42.42.10(pid=11305): Launched 17:37:11.454532 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:37:11.663502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:11.977074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Launched 17:37:12.250494 run iperf3-srv_10.42.42.10(pid=11307): Launched 17:37:12.367268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:37:12.575994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:12.890252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11308): Launched 17:37:13.165691 run iperf3-srv_10.42.42.10(pid=11309): Launched 17:37:13.283004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:37:13.493542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:13.808069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11310): Launched 17:37:14.080235 run iperf3-srv_10.42.42.10(pid=11311): Launched 17:37:14.196761 tst iperf3m4.py:8: start network... 17:37:14.405210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:14.886899 run create_hlr_db(pid=11312): Launched 17:37:15.015569 bus /gobi_6: Setting Powered False 17:37:16.076175 run create_hlr_db(pid=11312): Terminated: ok {rc=0} 17:37:16.514794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11314): Launched 17:37:16.846204 run osmo-hlr_10.42.42.2(pid=11315): Launched 17:37:17.085264 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:17.702983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11317): Launched 17:37:18.038317 run osmo-stp_10.42.42.5(pid=11318): Launched 17:37:18.167429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:18.742156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11320): Launched 17:37:18.870399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:19.153393 run patchelf(pid=11321): Launched 17:37:19.340463 run osmo-stp_10.42.42.5(pid=11318): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11318)] 17:37:19.482441 run osmo-stp_10.42.42.5(pid=11318): stdout: | (launched: 2022-12-13_17:37:17.976941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:19.625539 run osmo-stp_10.42.42.5(pid=11318): stderr: | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173718167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:19.768694 run osmo-stp_10.42.42.5(pid=11318): stdout: | (launched: 2022-12-13_17:37:17.976941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:19.905766 run osmo-stp_10.42.42.5(pid=11318): stderr: | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173718167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173718167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173718168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:20.067924 run patchelf(pid=11321): Terminating (SIGINT) 17:37:20.258913 run patchelf(pid=11321): Terminated: ok {rc=0} 17:37:20.396132 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11318): Process ended prematurely: osmo-stp_10.42.42.5(pid=11318) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11318)] [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:37:20.406618 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:37:20.435920 run osmo-hlr_10.42.42.2(pid=11315): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11315)] 17:37:20.487719 run osmo-hlr_10.42.42.2(pid=11315): stdout: | (launched: 2022-12-13_17:37:16.784257) 17:37:20.541381 run osmo-hlr_10.42.42.2(pid=11315): stderr: | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173717122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173717140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173717148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173717149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173717149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:20.594742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminating (SIGTERM) 17:37:20.637774 run iperf3-srv_10.42.42.10(pid=11305): Terminating (SIGTERM) 17:37:20.680836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminating (SIGTERM) 17:37:20.723746 run iperf3-srv_10.42.42.10(pid=11307): Terminating (SIGTERM) 17:37:20.766698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11308): Terminating (SIGTERM) 17:37:20.809804 run iperf3-srv_10.42.42.10(pid=11309): Terminating (SIGTERM) 17:37:20.853648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11310): Terminating (SIGTERM) 17:37:20.896677 run iperf3-srv_10.42.42.10(pid=11311): Terminating (SIGTERM) 17:37:20.939642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11314): Terminating (SIGTERM) 17:37:20.982541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11317): Terminating (SIGTERM) 17:37:21.025997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11320): Terminating (SIGTERM) 17:37:21.069263 --- ParallelTerminationStrategy: PID 11304 died... 17:37:21.089971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminated: ok {rc=0} 17:37:21.137795 --- ParallelTerminationStrategy: PID 11305 died... 17:37:21.158055 run iperf3-srv_10.42.42.10(pid=11305): Terminated {rc=256} 17:37:21.205263 --- ParallelTerminationStrategy: PID 11306 died... 17:37:21.225582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminated: ok {rc=0} 17:37:21.273257 --- ParallelTerminationStrategy: PID 11307 died... 17:37:21.293440 run iperf3-srv_10.42.42.10(pid=11307): Terminated {rc=256} 17:37:21.340655 --- ParallelTerminationStrategy: PID 11308 died... 17:37:21.361153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11308): Terminated: ok {rc=0} 17:37:21.408613 --- ParallelTerminationStrategy: PID 11309 died... 17:37:21.428894 run iperf3-srv_10.42.42.10(pid=11309): Terminated {rc=256} 17:37:21.476248 --- ParallelTerminationStrategy: PID 11310 died... 17:37:21.496519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11310): Terminated: ok {rc=0} 17:37:21.543717 --- ParallelTerminationStrategy: PID 11311 died... 17:37:21.563922 run iperf3-srv_10.42.42.10(pid=11311): Terminated {rc=256} 17:37:21.610937 --- ParallelTerminationStrategy: PID 11314 died... 17:37:21.631496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11314): Terminated: ok {rc=0} 17:37:21.678638 --- ParallelTerminationStrategy: PID 11317 died... 17:37:21.698992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11317): Terminated: ok {rc=0} 17:37:21.746280 --- ParallelTerminationStrategy: PID 11320 died... 17:37:21.766591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11320): Terminated: ok {rc=0} 17:37:21.856046 bus /gobi_4: Setting Powered False 17:37:22.957432 bus /gobi_4: Setting Powered False 17:37:24.075647 bus /gobi_1: Setting Powered False 17:37:25.175458 bus /gobi_1: Setting Powered False 17:37:26.293797 bus /gobi_0: Setting Powered False 17:37:27.393760 bus /gobi_0: Setting Powered False 17:37:28.513586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:37:29.618148 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:29.630570 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:29.685890 tst ping.py: using LAC 35178 17:37:29.815240 tst ping.py: using RAC 243 17:37:29.943453 tst ping.py: using CellId 35178 17:37:30.073192 tst ping.py: using BVCI 35179 17:37:30.193801 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.205710 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.217453 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.229104 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.241387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.253484 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.265670 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:30.277635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:30.400894 tst ping.py:19: start network... 17:37:30.623286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:31.149148 run create_hlr_db(pid=11323): Launched 17:37:31.329539 bus /gobi_6: Setting Powered False 17:37:32.394919 run create_hlr_db(pid=11323): Terminated: ok {rc=0} 17:37:32.838090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Launched 17:37:33.143926 run osmo-hlr_10.42.42.2(pid=11326): Launched 17:37:33.259287 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:33.789035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Launched 17:37:34.096354 run osmo-stp_10.42.42.5(pid=11329): Launched 17:37:34.211675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:34.739369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Launched 17:37:34.856623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:35.116606 run patchelf(pid=11332): Launched 17:37:35.286536 run osmo-stp_10.42.42.5(pid=11329): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] 17:37:35.416486 run osmo-stp_10.42.42.5(pid=11329): stdout: | (launched: 2022-12-13_17:37:34.039789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:35.548420 run osmo-stp_10.42.42.5(pid=11329): stderr: | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173734211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:35.679970 run osmo-stp_10.42.42.5(pid=11329): stdout: | (launched: 2022-12-13_17:37:34.039789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:35.805323 run osmo-stp_10.42.42.5(pid=11329): stderr: | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173734210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173734211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173734211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:35.953511 run patchelf(pid=11332): Terminating (SIGINT) 17:37:36.127203 run patchelf(pid=11332): Terminated: ok {rc=0} 17:37:36.252534 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11329): Process ended prematurely: osmo-stp_10.42.42.5(pid=11329) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:37:36.261790 tst ping.py:22: Test FAILED (6.6 sec) 17:37:36.289139 run osmo-hlr_10.42.42.2(pid=11326): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11326)] 17:37:36.337930 run osmo-hlr_10.42.42.2(pid=11326): stdout: | (launched: 2022-12-13_17:37:33.087509) 17:37:36.388429 run osmo-hlr_10.42.42.2(pid=11326): stderr: | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173733263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173733277 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173733287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173733287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173733287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:36.439588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Terminating (SIGTERM) 17:37:36.480113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Terminating (SIGTERM) 17:37:36.520518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Terminating (SIGTERM) 17:37:36.561467 --- ParallelTerminationStrategy: PID 11325 died... 17:37:36.580850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Terminated: ok {rc=0} 17:37:36.625750 --- ParallelTerminationStrategy: PID 11328 died... 17:37:36.644742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Terminated: ok {rc=0} 17:37:36.689861 --- ParallelTerminationStrategy: PID 11331 died... 17:37:36.709052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Terminated: ok {rc=0} 17:37:36.796926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:37:37.890058 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:37.902529 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:37.956455 tst ping_idle_ping.py: using LAC 35179 17:37:38.078116 tst ping_idle_ping.py: using RAC 244 17:37:38.199047 tst ping_idle_ping.py: using CellId 35179 17:37:38.321388 tst ping_idle_ping.py: using BVCI 35180 17:37:38.434232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.445726 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.456772 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.468005 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.479650 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.490811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.502054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:38.513168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:38.630784 tst ping_idle_ping.py:24: start network... 17:37:38.837394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:39.316020 run create_hlr_db(pid=11333): Launched 17:37:39.440737 bus /gobi_6: Setting Powered False 17:37:40.501739 run create_hlr_db(pid=11333): Terminated: ok {rc=0} 17:37:40.929342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11335): Launched 17:37:41.235627 run osmo-hlr_10.42.42.2(pid=11336): Launched 17:37:41.351963 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:41.879385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11338): Launched 17:37:42.186635 run osmo-stp_10.42.42.5(pid=11339): Launched 17:37:42.305356 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:42.834807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11341): Launched 17:37:42.952419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:43.211693 run patchelf(pid=11342): Launched 17:37:43.382285 run osmo-stp_10.42.42.5(pid=11339): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11339)] 17:37:43.511750 run osmo-stp_10.42.42.5(pid=11339): stdout: | (launched: 2022-12-13_17:37:42.129903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:43.644108 run osmo-stp_10.42.42.5(pid=11339): stderr: | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173742299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:43.775643 run osmo-stp_10.42.42.5(pid=11339): stdout: | (launched: 2022-12-13_17:37:42.129903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:43.900807 run osmo-stp_10.42.42.5(pid=11339): stderr: | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173742299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173742299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173742301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:44.049102 run patchelf(pid=11342): Terminating (SIGINT) 17:37:44.222635 run patchelf(pid=11342): Terminated: ok {rc=0} 17:37:44.348190 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11339): Process ended prematurely: osmo-stp_10.42.42.5(pid=11339) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11339)] [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:37:44.357337 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:37:44.384405 run osmo-hlr_10.42.42.2(pid=11336): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11336)] 17:37:44.432677 run osmo-hlr_10.42.42.2(pid=11336): stdout: | (launched: 2022-12-13_17:37:41.179222) 17:37:44.483039 run osmo-hlr_10.42.42.2(pid=11336): stderr: | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173741353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173741365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173741374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173741374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173741374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:44.533925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11335): Terminating (SIGTERM) 17:37:44.574287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11338): Terminating (SIGTERM) 17:37:44.614517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11341): Terminating (SIGTERM) 17:37:44.655090 --- ParallelTerminationStrategy: PID 11335 died... 17:37:44.674144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11335): Terminated: ok {rc=0} 17:37:44.718692 --- ParallelTerminationStrategy: PID 11338 died... 17:37:44.737716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11338): Terminated: ok {rc=0} 17:37:44.782366 --- ParallelTerminationStrategy: PID 11341 died... 17:37:44.801297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11341): Terminated: ok {rc=0} 17:37:44.887468 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:37:46.214454 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:46.227679 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:37:46.284096 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:37:46.322097 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:37:46.377673 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:37:46.422726 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:37:46.469147 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:37:47.048705 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:37:47.055636 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.068421 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:37:47.143580 tst switch_tch_pdch.py: using LAC 35180 17:37:47.277272 tst switch_tch_pdch.py: using RAC 245 17:37:47.404310 tst switch_tch_pdch.py: using CellId 35180 17:37:47.530461 tst switch_tch_pdch.py: using BVCI 35181 17:37:47.651263 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.663040 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.674658 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.686213 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.698118 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.709954 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.721944 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:47.733783 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:47.855393 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:47.978052 tst switch_tch_pdch.py:51: start network... 17:37:48.199408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:48.707060 run create_hlr_db(pid=11347): Launched 17:37:48.833270 bus /gobi_6: Setting Powered False 17:37:49.897395 run create_hlr_db(pid=11347): Terminated: ok {rc=0} 17:37:50.336889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Launched 17:37:50.643198 run osmo-hlr_10.42.42.2(pid=11350): Launched 17:37:50.762145 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:51.293660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11352): Launched 17:37:51.601591 run osmo-stp_10.42.42.5(pid=11353): Launched 17:37:51.719968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:52.251987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11355): Launched 17:37:52.368798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:52.627187 run patchelf(pid=11356): Launched 17:37:52.796824 run osmo-stp_10.42.42.5(pid=11353): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11353)] 17:37:52.926916 run osmo-stp_10.42.42.5(pid=11353): stdout: | (launched: 2022-12-13_17:37:51.544783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:53.058884 run osmo-stp_10.42.42.5(pid=11353): stderr: | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173751713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:53.190729 run osmo-stp_10.42.42.5(pid=11353): stdout: | (launched: 2022-12-13_17:37:51.544783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:53.316157 run osmo-stp_10.42.42.5(pid=11353): stderr: | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173751712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173751713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173751713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:53.464942 run patchelf(pid=11356): Terminating (SIGINT) 17:37:53.638778 run patchelf(pid=11356): Terminated: ok {rc=0} 17:37:53.764473 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11353): Process ended prematurely: osmo-stp_10.42.42.5(pid=11353) [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11353)] [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:37:53.773656 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 17:37:53.800730 run osmo-hlr_10.42.42.2(pid=11350): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11350)] 17:37:53.849644 run osmo-hlr_10.42.42.2(pid=11350): stdout: | (launched: 2022-12-13_17:37:50.586742) 17:37:53.900090 run osmo-hlr_10.42.42.2(pid=11350): stderr: | [0;m[1;31m20221213173750760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173750760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173750760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173750760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173750760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173750761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173750773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173750781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173750782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173750782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:53.951017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Terminating (SIGTERM) 17:37:53.991858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11352): Terminating (SIGTERM) 17:37:54.032702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11355): Terminating (SIGTERM) 17:37:54.073641 --- ParallelTerminationStrategy: PID 11349 died... 17:37:54.093193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Terminated: ok {rc=0} 17:37:54.138067 --- ParallelTerminationStrategy: PID 11352 died... 17:37:54.157178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11352): Terminated: ok {rc=0} 17:37:54.201743 --- ParallelTerminationStrategy: PID 11355 died... 17:37:54.220625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11355): Terminated: ok {rc=0} 17:37:54.309056 bus /gobi_0: Setting Powered False 17:37:55.412705 bus /gobi_0: Setting Powered False 17:37:56.531438 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:37:57.787937 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:57.794391 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:37:57.828406 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:37:57.864644 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:37:57.920055 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:37:57.954768 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:37:57.990695 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:37:58.545772 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:37:58.551174 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:58.562654 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:37:58.634769 tst switch_tch_pdch.py: using LAC 35181 17:37:58.762310 tst switch_tch_pdch.py: using RAC 246 17:37:58.891733 tst switch_tch_pdch.py: using CellId 35181 17:37:59.021362 tst switch_tch_pdch.py: using BVCI 35182 17:37:59.140081 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.151655 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.163025 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.174742 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.186245 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.197810 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.209544 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:59.221102 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:59.343167 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:59.462765 tst switch_tch_pdch.py:51: start network... 17:37:59.669627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:00.119874 run create_hlr_db(pid=11361): Launched 17:38:00.245077 bus /gobi_6: Setting Powered False 17:38:01.314623 run create_hlr_db(pid=11361): Terminated: ok {rc=0} 17:38:01.725526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11363): Launched 17:38:02.052015 run osmo-hlr_10.42.42.2(pid=11364): Launched 17:38:02.266646 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:02.763470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11366): Launched 17:38:03.069063 run osmo-stp_10.42.42.5(pid=11367): Launched 17:38:03.183872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:38:03.683478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11369): Launched 17:38:03.801667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:38:04.060932 run patchelf(pid=11370): Launched 17:38:04.230394 run osmo-stp_10.42.42.5(pid=11367): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11367)] 17:38:04.360046 run osmo-stp_10.42.42.5(pid=11367): stdout: | (launched: 2022-12-13_17:38:03.012378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:04.491459 run osmo-stp_10.42.42.5(pid=11367): stderr: | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173803183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:04.623131 run osmo-stp_10.42.42.5(pid=11367): stdout: | (launched: 2022-12-13_17:38:03.012378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:04.748312 run osmo-stp_10.42.42.5(pid=11367): stderr: | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173803183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173803183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173803184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:04.896750 run patchelf(pid=11370): Terminating (SIGINT) 17:38:05.070659 run patchelf(pid=11370): Terminated: ok {rc=0} 17:38:05.195560 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11367): Process ended prematurely: osmo-stp_10.42.42.5(pid=11367) [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11367)] [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:38:05.204375 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:38:05.231369 run osmo-hlr_10.42.42.2(pid=11364): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11364)] 17:38:05.280073 run osmo-hlr_10.42.42.2(pid=11364): stdout: | (launched: 2022-12-13_17:38:01.993140) 17:38:05.330225 run osmo-hlr_10.42.42.2(pid=11364): stderr: | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173802210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173802223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173802231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173802232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173802232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:05.380896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11363): Terminating (SIGTERM) 17:38:05.421497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11366): Terminating (SIGTERM) 17:38:05.461999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11369): Terminating (SIGTERM) 17:38:05.502690 --- ParallelTerminationStrategy: PID 11363 died... 17:38:05.522278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11363): Terminated: ok {rc=0} 17:38:05.567085 --- ParallelTerminationStrategy: PID 11366 died... 17:38:05.586059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11366): Terminated: ok {rc=0} 17:38:05.630585 --- ParallelTerminationStrategy: PID 11369 died... 17:38:05.649547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11369): Terminated: ok {rc=0} 17:38:05.735951 bus /gobi_0: Setting Powered False 17:38:06.837994 bus /gobi_0: Setting Powered False 17:38:07.953778 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:09.208707 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:09.212904 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:09.247621 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:38:09.256317 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:38:09.309523 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:09.344242 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:38:09.351315 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:38:09.891334 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:38:09.896547 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:38:09.907481 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:09.956170 tst mo_mt_sms.py: using LAC 35182 17:38:10.085247 tst mo_mt_sms.py: using RAC 247 17:38:10.212182 tst mo_mt_sms.py: using CellId 35182 17:38:10.340536 tst mo_mt_sms.py: using BVCI 35183 17:38:10.461434 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:10.580210 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:10.700442 tst mo_mt_sms.py:9: start nitb and bts... 17:38:10.923966 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:38:11.592387 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11374): Launched 17:38:11.921522 run osmo-nitb_10.42.42.2(pid=11375): Launched 17:38:12.105248 run osmo-nitb_10.42.42.2(pid=11375): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11375)] 17:38:12.253108 run osmo-nitb_10.42.42.2(pid=11375): stdout: | (launched: 2022-12-13_17:38:11.861170) 17:38:12.402049 run osmo-nitb_10.42.42.2(pid=11375): stderr: | (launched: 2022-12-13_17:38:11.910067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:12.550689 run osmo-nitb_10.42.42.2(pid=11375): stdout: | (launched: 2022-12-13_17:38:11.861170) 17:38:12.693623 run osmo-nitb_10.42.42.2(pid=11375): stderr: | (launched: 2022-12-13_17:38:11.910067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11375) [trial-2392↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11375)] 17:38:13.047228 tst osmo-nitb_10.42.42.2(pid=11375): stdout: | (launched: 2022-12-13_17:38:11.861170) 17:38:13.180741 tst osmo-nitb_10.42.42.2(pid=11375): stderr: | (launched: 2022-12-13_17:38:11.910067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:13.338300 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11375) [trial-2392↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11375)] [trial-2392↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 17:38:13.347633 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:38:13.355067 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11374): Terminating (SIGTERM) 17:38:13.567522 --- ParallelTerminationStrategy: PID 11374 died... 17:38:13.589733 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11374): Terminated: ok {rc=0} 17:38:13.680406 bus /sierra_3: Setting Powered False 17:38:14.781074 bus /sierra_3: Setting Powered False 17:38:15.926118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:17.150788 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:17.160095 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:17.197137 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:17.224406 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:38:17.275676 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:17.310198 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:17.337056 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:38:17.883460 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:38:17.888479 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:17.899329 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:17.947309 tst mo_mt_sms.py: using LAC 35183 17:38:18.067588 tst mo_mt_sms.py: using RAC 248 17:38:18.188602 tst mo_mt_sms.py: using CellId 35183 17:38:18.311786 tst mo_mt_sms.py: using BVCI 35184 17:38:18.422631 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.433337 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.443847 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.454309 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.464818 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:18.475859 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:18.595524 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:18.716676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:19.226455 run create_hlr_db(pid=11380): Launched 17:38:19.354529 bus /sierra_2: Setting Powered False 17:38:20.419815 run create_hlr_db(pid=11380): Terminated: ok {rc=0} 17:38:20.859756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Launched 17:38:21.166176 run osmo-hlr_10.42.42.2(pid=11383): Launched 17:38:21.282171 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:21.806871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Launched 17:38:22.113296 run osmo-stp_10.42.42.5(pid=11386): Launched 17:38:22.228193 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:22.781576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11388): Launched 17:38:23.088169 run osmo-msc_10.42.42.6(pid=11389): Launched 17:38:23.258760 run osmo-stp_10.42.42.5(pid=11386): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] 17:38:23.387462 run osmo-stp_10.42.42.5(pid=11386): stdout: | (launched: 2022-12-13_17:38:22.056632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:23.516210 run osmo-stp_10.42.42.5(pid=11386): stderr: | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173822227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:23.644056 run osmo-stp_10.42.42.5(pid=11386): stdout: | (launched: 2022-12-13_17:38:22.056632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:23.765913 run osmo-stp_10.42.42.5(pid=11386): stderr: | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173822226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173822227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173822227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:23.912030 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11386): Process ended prematurely: osmo-stp_10.42.42.5(pid=11386) [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 17:38:23.920810 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:38:23.947442 run osmo-hlr_10.42.42.2(pid=11383): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11383)] 17:38:23.996022 run osmo-hlr_10.42.42.2(pid=11383): stdout: | (launched: 2022-12-13_17:38:21.109742) 17:38:24.046321 run osmo-hlr_10.42.42.2(pid=11383): stderr: | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173821283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173821296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173821304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173821304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173821304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:24.116064 run osmo-msc_10.42.42.6(pid=11389): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11389)] 17:38:24.164329 run osmo-msc_10.42.42.6(pid=11389): stdout: | (launched: 2022-12-13_17:38:23.031389) 17:38:24.214022 run osmo-msc_10.42.42.6(pid=11389): stderr: | [0;m[38;5;43m20221213173823302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173823302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd15999fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173823302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173823302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173823302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173823302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173823304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173823304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173823305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173823305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:24.264281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Terminating (SIGTERM) 17:38:24.305019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Terminating (SIGTERM) 17:38:24.345493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11388): Terminating (SIGTERM) 17:38:24.385943 --- ParallelTerminationStrategy: PID 11382 died... 17:38:24.405607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Terminated: ok {rc=0} 17:38:24.450340 --- ParallelTerminationStrategy: PID 11385 died... 17:38:24.469537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Terminated: ok {rc=0} 17:38:24.513976 --- ParallelTerminationStrategy: PID 11388 died... 17:38:24.533068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11388): Terminated: ok {rc=0} 17:38:24.620115 bus /sierra_3: Setting Powered False 17:38:25.721742 bus /sierra_3: Setting Powered False 17:38:26.840197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:28.077980 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:28.082257 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:28.116834 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:38:28.124784 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:28.161451 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:28.196588 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:38:28.204410 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:28.723171 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:28.728399 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:38:28.739839 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:28.789368 tst assert_extension.py: using LAC 35184 17:38:28.926414 tst assert_extension.py: using RAC 249 17:38:29.062182 tst assert_extension.py: using CellId 35184 17:38:29.191623 tst assert_extension.py: using BVCI 35185 17:38:29.312429 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:29.428908 tst assert_extension.py:10: start nitb and bts... 17:38:29.634774 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:38:30.262407 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11394): Launched 17:38:30.570961 run osmo-nitb_10.42.42.2(pid=11395): Launched 17:38:30.742070 run osmo-nitb_10.42.42.2(pid=11395): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11395)] 17:38:30.897931 run osmo-nitb_10.42.42.2(pid=11395): stdout: | (launched: 2022-12-13_17:38:30.514343) 17:38:31.039575 run osmo-nitb_10.42.42.2(pid=11395): stderr: | (launched: 2022-12-13_17:38:30.559725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:31.180938 run osmo-nitb_10.42.42.2(pid=11395): stdout: | (launched: 2022-12-13_17:38:30.514343) 17:38:31.316761 run osmo-nitb_10.42.42.2(pid=11395): stderr: | (launched: 2022-12-13_17:38:30.559725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11395) [trial-2392↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11395)] 17:38:31.687706 tst osmo-nitb_10.42.42.2(pid=11395): stdout: | (launched: 2022-12-13_17:38:30.514343) 17:38:31.825507 tst osmo-nitb_10.42.42.2(pid=11395): stderr: | (launched: 2022-12-13_17:38:30.559725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:31.986786 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11395) [trial-2392↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11395)] [trial-2392↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 17:38:31.996708 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:38:32.004722 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11394): Terminating (SIGTERM) 17:38:32.218876 --- ParallelTerminationStrategy: PID 11394 died... 17:38:32.246157 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11394): Terminated: ok {rc=0} 17:38:32.337073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:33.517493 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:33.522150 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:33.556794 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:33.586784 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:33.623821 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:33.659947 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:33.688437 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:34.219438 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:34.225104 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.236446 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:34.290285 tst assert_extension.py: using LAC 35185 17:38:34.420696 tst assert_extension.py: using RAC 250 17:38:34.550573 tst assert_extension.py: using CellId 35185 17:38:34.681353 tst assert_extension.py: using BVCI 35186 17:38:34.802299 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.813638 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.824840 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.836121 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.848195 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:34.860281 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:34.980000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:35.454398 run create_hlr_db(pid=11399): Launched 17:38:35.582030 bus /sierra_2: Setting Powered False 17:38:36.642856 run create_hlr_db(pid=11399): Terminated: ok {rc=0} 17:38:37.091455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11401): Launched 17:38:37.420128 run osmo-hlr_10.42.42.2(pid=11402): Launched 17:38:37.546067 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:38.202484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11404): Launched 17:38:38.525440 run osmo-stp_10.42.42.5(pid=11405): Launched 17:38:38.648755 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:39.233345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11407): Launched 17:38:39.555952 run osmo-msc_10.42.42.6(pid=11408): Launched 17:38:39.736859 run osmo-stp_10.42.42.5(pid=11405): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11405)] 17:38:39.873326 run osmo-stp_10.42.42.5(pid=11405): stdout: | (launched: 2022-12-13_17:38:38.465834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:40.010318 run osmo-stp_10.42.42.5(pid=11405): stderr: | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173838655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:40.145243 run osmo-stp_10.42.42.5(pid=11405): stdout: | (launched: 2022-12-13_17:38:38.465834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:40.274417 run osmo-stp_10.42.42.5(pid=11405): stderr: | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173838654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173838655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173838655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:40.428387 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11405): Process ended prematurely: osmo-stp_10.42.42.5(pid=11405) [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11405)] [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py:17] 17:38:40.437491 tst assert_extension.py:17: Test FAILED (6.2 sec) 17:38:40.465060 run osmo-hlr_10.42.42.2(pid=11402): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11402)] 17:38:40.516757 run osmo-hlr_10.42.42.2(pid=11402): stdout: | (launched: 2022-12-13_17:38:37.359947) 17:38:40.570362 run osmo-hlr_10.42.42.2(pid=11402): stderr: | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173837557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173837571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173837579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173837579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173837579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:40.643735 run osmo-msc_10.42.42.6(pid=11408): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11408)] 17:38:40.694384 run osmo-msc_10.42.42.6(pid=11408): stdout: | (launched: 2022-12-13_17:38:39.496756) 17:38:40.747206 run osmo-msc_10.42.42.6(pid=11408): stderr: | [0;m[38;5;43m20221213173839817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173839817 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f680601ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173839817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173839819 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173839819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:40.800350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11401): Terminating (SIGTERM) 17:38:40.842901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11404): Terminating (SIGTERM) 17:38:40.886037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11407): Terminating (SIGTERM) 17:38:40.929010 --- ParallelTerminationStrategy: PID 11401 died... 17:38:40.949753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11401): Terminated: ok {rc=0} 17:38:40.996800 --- ParallelTerminationStrategy: PID 11404 died... 17:38:41.017417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11404): Terminated: ok {rc=0} 17:38:41.064483 --- ParallelTerminationStrategy: PID 11407 died... 17:38:41.084654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11407): Terminated: ok {rc=0} 17:38:41.174124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:38:42.394281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:42.402352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:38:42.435922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:38:42.462870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:38:42.512494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:38:42.546325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:38:42.572920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:38:43.126329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:38:43.176680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.188068 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:43.256527 tst mo_mt_call.py: using LAC 35186 17:38:43.379945 tst mo_mt_call.py: using RAC 251 17:38:43.499037 tst mo_mt_call.py: using CellId 35186 17:38:43.619821 tst mo_mt_call.py: using BVCI 35187 17:38:43.732341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.743791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.754981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.766032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.777392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:43.788597 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:43.911650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:44.030472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:44.507375 run create_hlr_db(pid=11413): Launched 17:38:44.638194 bus /sierra_2: Setting Powered False 17:38:45.703337 run create_hlr_db(pid=11413): Terminated: ok {rc=0} 17:38:46.195047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Launched 17:38:46.542546 run osmo-hlr_10.42.42.2(pid=11416): Launched 17:38:46.782968 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:47.466444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Launched 17:38:47.797093 run osmo-stp_10.42.42.5(pid=11430): Launched 17:38:48.034876 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:48.750678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11432): Launched 17:38:49.078192 run osmo-msc_10.42.42.6(pid=11433): Launched 17:38:49.427855 run osmo-stp_10.42.42.5(pid=11430): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] 17:38:49.713851 run osmo-stp_10.42.42.5(pid=11430): stdout: | (launched: 2022-12-13_17:38:47.739958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:50.000477 run osmo-stp_10.42.42.5(pid=11430): stderr: | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173848058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:50.142609 run osmo-stp_10.42.42.5(pid=11430): stdout: | (launched: 2022-12-13_17:38:47.739958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:50.267861 run osmo-stp_10.42.42.5(pid=11430): stderr: | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173848057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173848058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173848058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:50.419629 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11430): Process ended prematurely: osmo-stp_10.42.42.5(pid=11430) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:38:50.428886 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 17:38:50.455825 run osmo-hlr_10.42.42.2(pid=11416): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11416)] 17:38:50.504937 run osmo-hlr_10.42.42.2(pid=11416): stdout: | (launched: 2022-12-13_17:38:46.481688) 17:38:50.558383 run osmo-hlr_10.42.42.2(pid=11416): stderr: | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173846762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173846784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173846801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173846801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173846801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:50.629241 run osmo-msc_10.42.42.6(pid=11433): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11433)] 17:38:50.680531 run osmo-msc_10.42.42.6(pid=11433): stdout: | (launched: 2022-12-13_17:38:49.019464) 17:38:50.732736 run osmo-msc_10.42.42.6(pid=11433): stderr: | [0;m[38;5;43m20221213173849610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173849611 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f314fdd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173849611 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173849611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173849611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173849611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173849613 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173849613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173849613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173849614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:50.784050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Terminating (SIGTERM) 17:38:50.828348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Terminating (SIGTERM) 17:38:50.872735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11432): Terminating (SIGTERM) 17:38:50.918899 --- ParallelTerminationStrategy: PID 11415 died... 17:38:50.939088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Terminated: ok {rc=0} 17:38:50.986914 --- ParallelTerminationStrategy: PID 11428 died... 17:38:51.007315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Terminated: ok {rc=0} 17:38:51.053379 --- ParallelTerminationStrategy: PID 11432 died... 17:38:51.073590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11432): Terminated: ok {rc=0} 17:38:51.164563 bus /sierra_3: Setting Powered False 17:38:52.283825 bus /sierra_3: Setting Powered False 17:38:53.414970 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:38:54.569571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:54.582842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:54.657585 tst mo_mt_call_osmux.py: using LAC 35187 17:38:54.783858 tst mo_mt_call_osmux.py: using RAC 252 17:38:54.906614 tst mo_mt_call_osmux.py: using CellId 35187 17:38:55.031461 tst mo_mt_call_osmux.py: using BVCI 35188 17:38:55.148273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:55.160672 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:55.173158 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:55.185406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:55.197810 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:55.210663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:55.332841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:55.455088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:55.957885 run create_hlr_db(pid=11695): Launched 17:38:56.124273 bus /sierra_2: Setting Powered False 17:38:57.188143 run create_hlr_db(pid=11695): Terminated: ok {rc=0} 17:38:57.638971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Launched 17:38:57.973009 run osmo-hlr_10.42.42.2(pid=11698): Launched 17:38:58.214819 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:58.938717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Launched 17:38:59.272777 run osmo-stp_10.42.42.5(pid=11701): Launched 17:38:59.516470 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:00.240259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Launched 17:39:00.578936 run osmo-msc_10.42.42.6(pid=11704): Launched 17:39:00.983027 run osmo-stp_10.42.42.5(pid=11701): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] 17:39:01.309614 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-13_17:38:59.213445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:01.655621 run osmo-stp_10.42.42.5(pid=11701): stderr: | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173859537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:01.814139 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-13_17:38:59.213445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:01.967582 run osmo-stp_10.42.42.5(pid=11701): stderr: | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173859537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173859537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173859538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:02.153701 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:39:02.165272 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 17:39:02.199195 run osmo-hlr_10.42.42.2(pid=11698): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11698)] 17:39:02.254660 run osmo-hlr_10.42.42.2(pid=11698): stdout: | (launched: 2022-12-13_17:38:57.914207) 17:39:02.311942 run osmo-hlr_10.42.42.2(pid=11698): stderr: | [0;m[1;31m20221213173858247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173858248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173858248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173858248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173858248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173858248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173858269 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173858281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173858281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173858281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:02.394846 run osmo-msc_10.42.42.6(pid=11704): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11704)] 17:39:02.451882 run osmo-msc_10.42.42.6(pid=11704): stdout: | (launched: 2022-12-13_17:39:00.517624) 17:39:02.510472 run osmo-msc_10.42.42.6(pid=11704): stderr: | [0;m[38;5;43m20221213173901173 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173901173 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54d4c1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173901173 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173901173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173901174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173901174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173901175 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:02.572783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminating (SIGTERM) 17:39:02.619063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminating (SIGTERM) 17:39:02.670387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Terminating (SIGTERM) 17:39:02.722452 --- ParallelTerminationStrategy: PID 11697 died... 17:39:02.744894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminated: ok {rc=0} 17:39:02.798627 --- ParallelTerminationStrategy: PID 11700 died... 17:39:02.820655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminated: ok {rc=0} 17:39:02.873761 --- ParallelTerminationStrategy: PID 11703 died... 17:39:02.896651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Terminated: ok {rc=0} 17:39:03.002711 bus /sierra_3: Setting Powered False 17:39:04.131952 bus /sierra_3: Setting Powered False 17:39:05.256813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:39:06.525093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:06.533864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:39:06.573041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:39:06.602940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:39:06.658487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:39:06.695319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:39:06.727001 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:39:07.275882 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:39:07.335444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:07.348437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:39:07.424341 tst mo_mt_call.py: using LAC 35188 17:39:07.561256 tst mo_mt_call.py: using RAC 253 17:39:07.695108 tst mo_mt_call.py: using CellId 35188 17:39:07.830823 tst mo_mt_call.py: using BVCI 35189 17:39:07.956314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:07.969600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:07.982255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:07.995310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:08.009329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:08.022857 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:08.153217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:08.274395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:08.806233 run create_hlr_db(pid=11709): Launched 17:39:08.976300 bus /sierra_2: Setting Powered False 17:39:10.041781 run create_hlr_db(pid=11709): Terminated: ok {rc=0} 17:39:10.487047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11713): Launched 17:39:10.797105 run osmo-hlr_10.42.42.2(pid=11714): Launched 17:39:10.915302 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:11.462172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11716): Launched 17:39:11.771217 run osmo-stp_10.42.42.5(pid=11717): Launched 17:39:11.888561 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:12.452549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11719): Launched 17:39:12.763617 run osmo-msc_10.42.42.6(pid=11720): Launched 17:39:12.936940 run osmo-stp_10.42.42.5(pid=11717): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11717)] 17:39:13.067987 run osmo-stp_10.42.42.5(pid=11717): stdout: | (launched: 2022-12-13_17:39:11.714073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:13.198735 run osmo-stp_10.42.42.5(pid=11717): stderr: | [0;m[38;5;43m20221213173911884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173911885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173911885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173911885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:13.327493 run osmo-stp_10.42.42.5(pid=11717): stdout: | (launched: 2022-12-13_17:39:11.714073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:13.449756 run osmo-stp_10.42.42.5(pid=11717): stderr: | [0;m[38;5;43m20221213173911884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173911885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173911885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173911885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173911886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:13.596570 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11717): Process ended prematurely: osmo-stp_10.42.42.5(pid=11717) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11717)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:39:13.605682 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:39:13.632304 run osmo-hlr_10.42.42.2(pid=11714): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11714)] 17:39:13.680698 run osmo-hlr_10.42.42.2(pid=11714): stdout: | (launched: 2022-12-13_17:39:10.739748) 17:39:13.730748 run osmo-hlr_10.42.42.2(pid=11714): stderr: | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173910917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173910930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173910939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173910939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173910939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:13.800927 run osmo-msc_10.42.42.6(pid=11720): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11720)] 17:39:13.849448 run osmo-msc_10.42.42.6(pid=11720): stdout: | (launched: 2022-12-13_17:39:12.706318) 17:39:13.899574 run osmo-msc_10.42.42.6(pid=11720): stderr: | [0;m[38;5;43m20221213173912977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173912977 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7bd37b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173912977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173912977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173912977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173912977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173912979 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173912979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173912980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173912980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:13.950209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11713): Terminating (SIGTERM) 17:39:13.990282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11716): Terminating (SIGTERM) 17:39:14.030554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11719): Terminating (SIGTERM) 17:39:14.071182 --- ParallelTerminationStrategy: PID 11713 died... 17:39:14.090606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11713): Terminated: ok {rc=0} 17:39:14.134997 --- ParallelTerminationStrategy: PID 11716 died... 17:39:14.153754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11716): Terminated: ok {rc=0} 17:39:14.197966 --- ParallelTerminationStrategy: PID 11719 died... 17:39:14.216759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11719): Terminated: ok {rc=0} 17:39:14.301119 bus /sierra_3: Setting Powered False 17:39:15.400817 bus /sierra_3: Setting Powered False 17:39:16.519156 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:39:17.667023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:17.678998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:39:17.749726 tst mo_mt_call_osmux.py: using LAC 35189 17:39:17.870663 tst mo_mt_call_osmux.py: using RAC 254 17:39:17.993090 tst mo_mt_call_osmux.py: using CellId 35189 17:39:18.114571 tst mo_mt_call_osmux.py: using BVCI 35190 17:39:18.228068 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:18.239372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:18.250423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:18.261599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:18.272676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:18.283698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:18.405993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:18.528008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:19.040106 run create_hlr_db(pid=11722): Launched 17:39:19.169120 bus /sierra_2: Setting Powered False 17:39:20.234226 run create_hlr_db(pid=11722): Terminated: ok {rc=0} 17:39:20.678525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Launched 17:39:20.990108 run osmo-hlr_10.42.42.2(pid=11725): Launched 17:39:21.107867 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:21.641983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Launched 17:39:21.952146 run osmo-stp_10.42.42.5(pid=11728): Launched 17:39:22.071299 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:22.634890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11730): Launched 17:39:22.946279 run osmo-msc_10.42.42.6(pid=11731): Launched 17:39:23.119365 run osmo-stp_10.42.42.5(pid=11728): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] 17:39:23.249342 run osmo-stp_10.42.42.5(pid=11728): stdout: | (launched: 2022-12-13_17:39:21.894849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:23.379887 run osmo-stp_10.42.42.5(pid=11728): stderr: | [0;m[38;5;43m20221213173922063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173922063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173922064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173922064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:23.508420 run osmo-stp_10.42.42.5(pid=11728): stdout: | (launched: 2022-12-13_17:39:21.894849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:23.631223 run osmo-stp_10.42.42.5(pid=11728): stderr: | [0;m[38;5;43m20221213173922063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173922063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173922064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173922064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173922065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:23.778193 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11728): Process ended prematurely: osmo-stp_10.42.42.5(pid=11728) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:39:23.787093 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:39:23.813552 run osmo-hlr_10.42.42.2(pid=11725): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11725)] 17:39:23.861964 run osmo-hlr_10.42.42.2(pid=11725): stdout: | (launched: 2022-12-13_17:39:20.932877) 17:39:23.912042 run osmo-hlr_10.42.42.2(pid=11725): stderr: | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173921107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173921119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173921127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173921127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173921127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:23.981724 run osmo-msc_10.42.42.6(pid=11731): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11731)] 17:39:24.029815 run osmo-msc_10.42.42.6(pid=11731): stdout: | (launched: 2022-12-13_17:39:22.888158) 17:39:24.079601 run osmo-msc_10.42.42.6(pid=11731): stderr: | [0;m[38;5;43m20221213173923159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173923159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d3b185c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173923159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173923159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173923160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173923160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173923162 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173923162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173923162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173923162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:24.130060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Terminating (SIGTERM) 17:39:24.170164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Terminating (SIGTERM) 17:39:24.210159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11730): Terminating (SIGTERM) 17:39:24.250398 --- ParallelTerminationStrategy: PID 11724 died... 17:39:24.269675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Terminated: ok {rc=0} 17:39:24.314080 --- ParallelTerminationStrategy: PID 11727 died... 17:39:24.333339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Terminated: ok {rc=0} 17:39:24.377676 --- ParallelTerminationStrategy: PID 11730 died... 17:39:24.396867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11730): Terminated: ok {rc=0} 17:39:24.484627 bus /sierra_3: Setting Powered False 17:39:25.585592 bus /sierra_3: Setting Powered False 17:39:26.702065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:39:27.953871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:27.960234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:39:27.993663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:39:28.020164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:39:28.071442 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:39:28.105314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:39:28.132035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:39:28.684430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:39:28.734993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:28.746233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:28.821823 tst mo_mt_call.py: using LAC 35190 17:39:28.942064 tst mo_mt_call.py: using RAC 255 17:39:29.063852 tst mo_mt_call.py: using CellId 35190 17:39:29.185175 tst mo_mt_call.py: using BVCI 35191 17:39:29.296600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:29.307899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:29.318927 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:29.330036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:29.341199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:29.352214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:29.474861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:29.595444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:30.074611 run create_hlr_db(pid=11736): Launched 17:39:30.202963 bus /sierra_2: Setting Powered False 17:39:31.263706 run create_hlr_db(pid=11736): Terminated: ok {rc=0} 17:39:31.751365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11738): Launched 17:39:32.105749 run osmo-hlr_10.42.42.2(pid=11739): Launched 17:39:32.230233 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:32.763904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Launched 17:39:33.074381 run osmo-stp_10.42.42.5(pid=11742): Launched 17:39:33.194742 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:33.754286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11744): Launched 17:39:34.066733 run osmo-msc_10.42.42.6(pid=11745): Launched 17:39:34.240816 run osmo-stp_10.42.42.5(pid=11742): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11742)] 17:39:34.371408 run osmo-stp_10.42.42.5(pid=11742): stdout: | (launched: 2022-12-13_17:39:33.017162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:34.502774 run osmo-stp_10.42.42.5(pid=11742): stderr: | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173933186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173933186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173933186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173933187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:34.631500 run osmo-stp_10.42.42.5(pid=11742): stdout: | (launched: 2022-12-13_17:39:33.017162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:34.753773 run osmo-stp_10.42.42.5(pid=11742): stderr: | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173933185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173933186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173933186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173933186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173933187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:34.900619 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11742): Process ended prematurely: osmo-stp_10.42.42.5(pid=11742) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11742)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:39:34.909705 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:39:34.936169 run osmo-hlr_10.42.42.2(pid=11739): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11739)] 17:39:34.984270 run osmo-hlr_10.42.42.2(pid=11739): stdout: | (launched: 2022-12-13_17:39:32.040252) 17:39:35.034275 run osmo-hlr_10.42.42.2(pid=11739): stderr: | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173932278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173932292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173932302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173932302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173932302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:35.104011 run osmo-msc_10.42.42.6(pid=11745): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11745)] 17:39:35.152125 run osmo-msc_10.42.42.6(pid=11745): stdout: | (launched: 2022-12-13_17:39:34.009312) 17:39:35.201903 run osmo-msc_10.42.42.6(pid=11745): stderr: | [0;m[38;5;43m20221213173934281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173934281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff2d5b17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173934281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173934281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173934281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173934282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173934283 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173934284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173934284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173934284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:35.251970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11738): Terminating (SIGTERM) 17:39:35.292219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Terminating (SIGTERM) 17:39:35.332478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11744): Terminating (SIGTERM) 17:39:35.372922 --- ParallelTerminationStrategy: PID 11738 died... 17:39:35.392218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11738): Terminated: ok {rc=0} 17:39:35.437020 --- ParallelTerminationStrategy: PID 11741 died... 17:39:35.455765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Terminated: ok {rc=0} 17:39:35.499808 --- ParallelTerminationStrategy: PID 11744 died... 17:39:35.518498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11744): Terminated: ok {rc=0} 17:39:35.605013 bus /sierra_3: Setting Powered False 17:39:36.704864 bus /sierra_3: Setting Powered False 17:39:37.822999 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:39:38.972910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:38.984808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:39.054545 tst mo_mt_call_osmux.py: using LAC 35191 17:39:39.175939 tst mo_mt_call_osmux.py: using RAC 1 17:39:39.300253 tst mo_mt_call_osmux.py: using CellId 35191 17:39:39.422438 tst mo_mt_call_osmux.py: using BVCI 35192 17:39:39.535817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:39.547095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:39.558307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:39.569409 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:39.580523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:39.591584 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:39.715755 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:39.836482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:40.346389 run create_hlr_db(pid=11747): Launched 17:39:40.475289 bus /sierra_2: Setting Powered False 17:39:41.540599 run create_hlr_db(pid=11747): Terminated: ok {rc=0} 17:39:41.983815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Launched 17:39:42.295307 run osmo-hlr_10.42.42.2(pid=11750): Launched 17:39:42.413554 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:42.962992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Launched 17:39:43.272673 run osmo-stp_10.42.42.5(pid=11753): Launched 17:39:43.390319 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:43.950829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Launched 17:39:44.261233 run osmo-msc_10.42.42.6(pid=11756): Launched 17:39:44.433538 run osmo-stp_10.42.42.5(pid=11753): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] 17:39:44.564611 run osmo-stp_10.42.42.5(pid=11753): stdout: | (launched: 2022-12-13_17:39:43.215375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:44.695926 run osmo-stp_10.42.42.5(pid=11753): stderr: | [0;m[38;5;43m20221213173943386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173943386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173943387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173943387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:44.824745 run osmo-stp_10.42.42.5(pid=11753): stdout: | (launched: 2022-12-13_17:39:43.215375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:44.947745 run osmo-stp_10.42.42.5(pid=11753): stderr: | [0;m[38;5;43m20221213173943386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173943386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173943387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173943387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173943388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:45.094912 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11753): Process ended prematurely: osmo-stp_10.42.42.5(pid=11753) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:39:45.104044 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:39:45.130482 run osmo-hlr_10.42.42.2(pid=11750): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11750)] 17:39:45.178890 run osmo-hlr_10.42.42.2(pid=11750): stdout: | (launched: 2022-12-13_17:39:42.237929) 17:39:45.228826 run osmo-hlr_10.42.42.2(pid=11750): stderr: | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173942415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173942427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173942436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173942436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173942436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:45.298557 run osmo-msc_10.42.42.6(pid=11756): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11756)] 17:39:45.346981 run osmo-msc_10.42.42.6(pid=11756): stdout: | (launched: 2022-12-13_17:39:44.203751) 17:39:45.396632 run osmo-msc_10.42.42.6(pid=11756): stderr: | [0;m[38;5;43m20221213173944475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173944476 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f18bd94cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173944476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173944476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173944476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173944476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173944478 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173944478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173944479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173944479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:45.446835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Terminating (SIGTERM) 17:39:45.487112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Terminating (SIGTERM) 17:39:45.527318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Terminating (SIGTERM) 17:39:45.567830 --- ParallelTerminationStrategy: PID 11749 died... 17:39:45.587390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Terminated: ok {rc=0} 17:39:45.632251 --- ParallelTerminationStrategy: PID 11752 died... 17:39:45.651357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Terminated: ok {rc=0} 17:39:45.695687 --- ParallelTerminationStrategy: PID 11755 died... 17:39:45.714505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Terminated: ok {rc=0} 17:39:45.801557 bus /sierra_3: Setting Powered False 17:39:46.911804 bus /sierra_3: Setting Powered False 17:39:48.030769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:39:49.278575 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:49.285112 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:39:49.318900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:39:49.346322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:39:49.399147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:39:49.435232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:39:49.463281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:39:50.014216 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:39:50.064531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.076001 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:39:50.145363 tst mo_mt_call.py: using LAC 35192 17:39:50.276276 tst mo_mt_call.py: using RAC 2 17:39:50.408321 tst mo_mt_call.py: using CellId 35192 17:39:50.537400 tst mo_mt_call.py: using BVCI 35193 17:39:50.657835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.669790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.681536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.693018 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.704893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:50.716695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:50.837170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:50.958268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:51.469367 run create_hlr_db(pid=11761): Launched 17:39:51.595805 bus /sierra_2: Setting Powered False 17:39:52.659181 run create_hlr_db(pid=11761): Terminated: ok {rc=0} 17:39:53.103756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11763): Launched 17:39:53.405749 run osmo-hlr_10.42.42.2(pid=11764): Launched 17:39:53.520409 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:54.048150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11766): Launched 17:39:54.348615 run osmo-stp_10.42.42.5(pid=11767): Launched 17:39:54.462327 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:55.007939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11769): Launched 17:39:55.310694 run osmo-msc_10.42.42.6(pid=11770): Launched 17:39:55.478592 run osmo-stp_10.42.42.5(pid=11767): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11767)] 17:39:55.606304 run osmo-stp_10.42.42.5(pid=11767): stdout: | (launched: 2022-12-13_17:39:54.293470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:55.734028 run osmo-stp_10.42.42.5(pid=11767): stderr: | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173954460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:55.859570 run osmo-stp_10.42.42.5(pid=11767): stdout: | (launched: 2022-12-13_17:39:54.293470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:55.978909 run osmo-stp_10.42.42.5(pid=11767): stderr: | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213173954459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213173954460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213173954460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:56.121995 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11767): Process ended prematurely: osmo-stp_10.42.42.5(pid=11767) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11767)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:39:56.130791 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:39:56.157059 run osmo-hlr_10.42.42.2(pid=11764): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11764)] 17:39:56.204593 run osmo-hlr_10.42.42.2(pid=11764): stdout: | (launched: 2022-12-13_17:39:53.350474) 17:39:56.253952 run osmo-hlr_10.42.42.2(pid=11764): stderr: | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213173953522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213173953535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213173953543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213173953544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213173953544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:56.322733 run osmo-msc_10.42.42.6(pid=11770): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11770)] 17:39:56.370573 run osmo-msc_10.42.42.6(pid=11770): stdout: | (launched: 2022-12-13_17:39:55.254613) 17:39:56.419784 run osmo-msc_10.42.42.6(pid=11770): stderr: | [0;m[38;5;43m20221213173955525 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213173955525 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd33d22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213173955525 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213173955526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213173955526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213173955526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213173955528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213173955528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213173955528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213173955528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:56.469597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11763): Terminating (SIGTERM) 17:39:56.509058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11766): Terminating (SIGTERM) 17:39:56.548506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11769): Terminating (SIGTERM) 17:39:56.588474 --- ParallelTerminationStrategy: PID 11763 died... 17:39:56.607518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11763): Terminated: ok {rc=0} 17:39:56.651958 --- ParallelTerminationStrategy: PID 11766 died... 17:39:56.670756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11766): Terminated: ok {rc=0} 17:39:56.714653 --- ParallelTerminationStrategy: PID 11769 died... 17:39:56.733521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11769): Terminated: ok {rc=0} 17:39:56.819663 bus /sierra_3: Setting Powered False 17:39:57.919241 bus /sierra_3: Setting Powered False 17:39:59.034384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:40:00.182667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.194847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:40:00.267768 tst mo_mt_call_osmux.py: using LAC 35193 17:40:00.394071 tst mo_mt_call_osmux.py: using RAC 3 17:40:00.525571 tst mo_mt_call_osmux.py: using CellId 35193 17:40:00.651114 tst mo_mt_call_osmux.py: using BVCI 35194 17:40:00.770154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.781895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.793365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.804755 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.816621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:40:00.831182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:40:00.977990 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:40:01.108434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:01.701773 run create_hlr_db(pid=11772): Launched 17:40:01.873004 bus /sierra_2: Setting Powered False 17:40:02.936611 run create_hlr_db(pid=11772): Terminated: ok {rc=0} 17:40:03.409673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11784): Launched 17:40:03.732929 run osmo-hlr_10.42.42.2(pid=11785): Launched 17:40:03.855350 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:04.414966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11787): Launched 17:40:04.737964 run osmo-stp_10.42.42.5(pid=11788): Launched 17:40:04.861450 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:05.444563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11790): Launched 17:40:05.767408 run osmo-msc_10.42.42.6(pid=11791): Launched 17:40:05.946588 run osmo-stp_10.42.42.5(pid=11788): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11788)] 17:40:06.084940 run osmo-stp_10.42.42.5(pid=11788): stdout: | (launched: 2022-12-13_17:40:04.678593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:06.225307 run osmo-stp_10.42.42.5(pid=11788): stderr: | [0;m[38;5;43m20221213174004864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174004865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174004865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174004865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:06.360652 run osmo-stp_10.42.42.5(pid=11788): stdout: | (launched: 2022-12-13_17:40:04.678593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:06.489289 run osmo-stp_10.42.42.5(pid=11788): stderr: | [0;m[38;5;43m20221213174004864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174004865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174004865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174004865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174004866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:06.642891 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11788): Process ended prematurely: osmo-stp_10.42.42.5(pid=11788) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11788)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:40:06.652594 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:40:06.680464 run osmo-hlr_10.42.42.2(pid=11785): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11785)] 17:40:06.731595 run osmo-hlr_10.42.42.2(pid=11785): stdout: | (launched: 2022-12-13_17:40:03.673847) 17:40:06.784507 run osmo-hlr_10.42.42.2(pid=11785): stderr: | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174003866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174003880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174003890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174003890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174003890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:06.857609 run osmo-msc_10.42.42.6(pid=11791): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11791)] 17:40:06.907881 run osmo-msc_10.42.42.6(pid=11791): stdout: | (launched: 2022-12-13_17:40:05.708331) 17:40:06.960333 run osmo-msc_10.42.42.6(pid=11791): stderr: | [0;m[38;5;43m20221213174006025 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174006025 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba60c74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174006025 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174006025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174006025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174006025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174006027 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174006027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174006028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174006028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:07.013246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11784): Terminating (SIGTERM) 17:40:07.055106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11787): Terminating (SIGTERM) 17:40:07.098143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11790): Terminating (SIGTERM) 17:40:07.140661 --- ParallelTerminationStrategy: PID 11784 died... 17:40:07.161190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11784): Terminated: ok {rc=0} 17:40:07.207909 --- ParallelTerminationStrategy: PID 11787 died... 17:40:07.227870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11787): Terminated: ok {rc=0} 17:40:07.274255 --- ParallelTerminationStrategy: PID 11790 died... 17:40:07.294253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11790): Terminated: ok {rc=0} 17:40:07.383208 bus /sierra_3: Setting Powered False 17:40:08.481612 bus /sierra_3: Setting Powered False 17:40:09.600277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:40:10.849889 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:10.856273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:40:10.889300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:40:10.915754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:40:10.966923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:40:11.001416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:40:11.029019 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:40:11.577218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:40:11.625570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:11.636729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:40:11.705454 tst mo_mt_call.py: using LAC 35194 17:40:11.823666 tst mo_mt_call.py: using RAC 4 17:40:11.943710 tst mo_mt_call.py: using CellId 35194 17:40:12.061349 tst mo_mt_call.py: using BVCI 35195 17:40:12.169568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:12.180572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:12.191514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:12.202519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:12.213489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:12.224370 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:12.346223 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:12.463863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:12.949175 run create_hlr_db(pid=11828): Launched 17:40:13.105223 bus /sierra_2: Setting Powered False 17:40:14.172588 run create_hlr_db(pid=11828): Terminated: ok {rc=0} 17:40:14.649849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12110): Launched 17:40:14.983969 run osmo-hlr_10.42.42.2(pid=12154): Launched 17:40:15.110135 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:15.676456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12156): Launched 17:40:16.025497 run osmo-stp_10.42.42.5(pid=12157): Launched 17:40:16.233137 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:16.946052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12159): Launched 17:40:17.378771 run osmo-msc_10.42.42.6(pid=12160): Launched 17:40:17.620852 run osmo-stp_10.42.42.5(pid=12157): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12157)] 17:40:17.758954 run osmo-stp_10.42.42.5(pid=12157): stdout: | (launched: 2022-12-13_17:40:15.966267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:17.900126 run osmo-stp_10.42.42.5(pid=12157): stderr: | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174016275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:18.037808 run osmo-stp_10.42.42.5(pid=12157): stdout: | (launched: 2022-12-13_17:40:15.966267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:18.168826 run osmo-stp_10.42.42.5(pid=12157): stderr: | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174016274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174016275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174016275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:18.325810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12157): Process ended prematurely: osmo-stp_10.42.42.5(pid=12157) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12157)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:40:18.335640 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:40:18.363833 run osmo-hlr_10.42.42.2(pid=12154): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12154)] 17:40:18.415852 run osmo-hlr_10.42.42.2(pid=12154): stdout: | (launched: 2022-12-13_17:40:14.923848) 17:40:18.469114 run osmo-hlr_10.42.42.2(pid=12154): stderr: | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174015117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174015130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:18.542752 run osmo-msc_10.42.42.6(pid=12160): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12160)] 17:40:18.593972 run osmo-msc_10.42.42.6(pid=12160): stdout: | (launched: 2022-12-13_17:40:17.305727) 17:40:18.647166 run osmo-msc_10.42.42.6(pid=12160): stderr: | [0;m[38;5;43m20221213174017635 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174017635 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae58b5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174017636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174017636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174017636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174017636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174017638 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174017638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174017638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174017638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:18.700476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12110): Terminating (SIGTERM) 17:40:18.743169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12156): Terminating (SIGTERM) 17:40:18.786141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12159): Terminating (SIGTERM) 17:40:18.829542 --- ParallelTerminationStrategy: PID 12110 died... 17:40:18.850494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12110): Terminated: ok {rc=0} 17:40:18.898190 --- ParallelTerminationStrategy: PID 12156 died... 17:40:18.918641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12156): Terminated: ok {rc=0} 17:40:18.966460 --- ParallelTerminationStrategy: PID 12159 died... 17:40:18.986901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12159): Terminated: ok {rc=0} 17:40:19.077653 bus /sierra_3: Setting Powered False 17:40:20.177089 bus /sierra_3: Setting Powered False 17:40:21.294703 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:40:22.455363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:22.469522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:40:22.541656 tst mo_mt_call_osmux.py: using LAC 35195 17:40:22.665065 tst mo_mt_call_osmux.py: using RAC 5 17:40:22.784826 tst mo_mt_call_osmux.py: using CellId 35195 17:40:22.903542 tst mo_mt_call_osmux.py: using BVCI 35196 17:40:23.014238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:23.025560 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:23.036556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:23.047565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:23.059185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:23.070748 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:23.192893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:23.312665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:23.784616 run create_hlr_db(pid=12162): Launched 17:40:23.909459 bus /sierra_2: Setting Powered False 17:40:24.976243 run create_hlr_db(pid=12162): Terminated: ok {rc=0} 17:40:25.417978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12339): Launched 17:40:25.760081 run osmo-hlr_10.42.42.2(pid=12340): Launched 17:40:26.010483 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:26.678792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12342): Launched 17:40:27.022728 run osmo-stp_10.42.42.5(pid=12343): Launched 17:40:27.270252 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:27.944140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12345): Launched 17:40:28.290475 run osmo-msc_10.42.42.6(pid=12346): Launched 17:40:28.652045 run osmo-stp_10.42.42.5(pid=12343): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12343)] 17:40:28.946921 run osmo-stp_10.42.42.5(pid=12343): stdout: | (launched: 2022-12-13_17:40:26.962572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:29.111401 run osmo-stp_10.42.42.5(pid=12343): stderr: | [0;m[38;5;43m20221213174027254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174027254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174027255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174027255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:29.251787 run osmo-stp_10.42.42.5(pid=12343): stdout: | (launched: 2022-12-13_17:40:26.962572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:29.388523 run osmo-stp_10.42.42.5(pid=12343): stderr: | [0;m[38;5;43m20221213174027254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174027254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174027255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174027255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174027256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:29.551553 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12343): Process ended prematurely: osmo-stp_10.42.42.5(pid=12343) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12343)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:40:29.562520 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 17:40:29.591729 run osmo-hlr_10.42.42.2(pid=12340): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12340)] 17:40:29.647360 run osmo-hlr_10.42.42.2(pid=12340): stdout: | (launched: 2022-12-13_17:40:25.699906) 17:40:29.703017 run osmo-hlr_10.42.42.2(pid=12340): stderr: | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174026004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174026020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174026041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174026041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174026041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:29.781538 run osmo-msc_10.42.42.6(pid=12346): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12346)] 17:40:29.835433 run osmo-msc_10.42.42.6(pid=12346): stdout: | (launched: 2022-12-13_17:40:28.231076) 17:40:29.890182 run osmo-msc_10.42.42.6(pid=12346): stderr: | [0;m[38;5;43m20221213174028732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174028732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41169ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174028732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174028732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174028737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174028737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174028739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174028739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174028739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174028739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:29.946707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12339): Terminating (SIGTERM) 17:40:29.990867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12342): Terminating (SIGTERM) 17:40:30.037737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12345): Terminating (SIGTERM) 17:40:30.084832 --- ParallelTerminationStrategy: PID 12339 died... 17:40:30.107606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12339): Terminated: ok {rc=0} 17:40:30.161110 --- ParallelTerminationStrategy: PID 12342 died... 17:40:30.182372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12342): Terminated: ok {rc=0} 17:40:30.232269 --- ParallelTerminationStrategy: PID 12345 died... 17:40:30.254333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12345): Terminated: ok {rc=0} 17:40:30.349266 bus /sierra_3: Setting Powered False 17:40:31.458762 bus /sierra_3: Setting Powered False 17:40:32.585260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:40:33.844020 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:33.850598 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:40:33.883691 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:40:33.910545 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:40:33.960251 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:40:33.995330 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:40:34.023214 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:40:34.573521 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:40:34.623430 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:34.634777 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:34.703880 tst mo_mt_call.py: using LAC 35196 17:40:34.831619 tst mo_mt_call.py: using RAC 6 17:40:34.958614 tst mo_mt_call.py: using CellId 35196 17:40:35.085284 tst mo_mt_call.py: using BVCI 35197 17:40:35.205408 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:35.217221 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:35.228579 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:35.240070 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:35.251898 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:35.263668 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:35.382955 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:35.504139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:36.008802 run create_hlr_db(pid=12352): Launched 17:40:36.133089 bus /sierra_2: Setting Powered False 17:40:37.198313 run create_hlr_db(pid=12352): Terminated: ok {rc=0} 17:40:37.637425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12354): Launched 17:40:37.943585 run osmo-hlr_10.42.42.2(pid=12355): Launched 17:40:38.059427 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:38.586458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12357): Launched 17:40:38.892161 run osmo-stp_10.42.42.5(pid=12358): Launched 17:40:39.008523 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:39.563061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12360): Launched 17:40:39.870288 run osmo-msc_10.42.42.6(pid=12361): Launched 17:40:40.040075 run osmo-stp_10.42.42.5(pid=12358): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12358)] 17:40:40.168585 run osmo-stp_10.42.42.5(pid=12358): stdout: | (launched: 2022-12-13_17:40:38.836099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:40.296933 run osmo-stp_10.42.42.5(pid=12358): stderr: | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174039006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:40.424118 run osmo-stp_10.42.42.5(pid=12358): stdout: | (launched: 2022-12-13_17:40:38.836099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:40.545350 run osmo-stp_10.42.42.5(pid=12358): stderr: | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174039005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174039006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174039006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:40.690733 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12358): Process ended prematurely: osmo-stp_10.42.42.5(pid=12358) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12358)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:40:40.699743 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:40:40.725963 run osmo-hlr_10.42.42.2(pid=12355): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12355)] 17:40:40.773832 run osmo-hlr_10.42.42.2(pid=12355): stdout: | (launched: 2022-12-13_17:40:37.887491) 17:40:40.823937 run osmo-hlr_10.42.42.2(pid=12355): stderr: | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174038061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174038076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174038085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174038085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174038086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:40.893606 run osmo-msc_10.42.42.6(pid=12361): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12361)] 17:40:40.941642 run osmo-msc_10.42.42.6(pid=12361): stdout: | (launched: 2022-12-13_17:40:39.813329) 17:40:40.991419 run osmo-msc_10.42.42.6(pid=12361): stderr: | [0;m[38;5;43m20221213174040083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174040084 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ba595dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174040084 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174040084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174040084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174040084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174040086 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174040087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174040087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174040087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:41.042786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12354): Terminating (SIGTERM) 17:40:41.082583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12357): Terminating (SIGTERM) 17:40:41.122537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12360): Terminating (SIGTERM) 17:40:41.162554 --- ParallelTerminationStrategy: PID 12354 died... 17:40:41.181760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12354): Terminated: ok {rc=0} 17:40:41.226025 --- ParallelTerminationStrategy: PID 12357 died... 17:40:41.244645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12357): Terminated: ok {rc=0} 17:40:41.288818 --- ParallelTerminationStrategy: PID 12360 died... 17:40:41.307621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12360): Terminated: ok {rc=0} 17:40:41.394005 bus /sierra_3: Setting Powered False 17:40:42.494104 bus /sierra_3: Setting Powered False 17:40:43.610677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:40:44.757531 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:44.769398 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:44.840269 tst mo_mt_call_osmux.py: using LAC 35197 17:40:44.961062 tst mo_mt_call_osmux.py: using RAC 7 17:40:45.083367 tst mo_mt_call_osmux.py: using CellId 35197 17:40:45.204740 tst mo_mt_call_osmux.py: using BVCI 35198 17:40:45.317422 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:45.328717 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:45.339871 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:45.350985 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:45.362121 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:45.373359 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:45.490199 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:45.607728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:46.126590 run create_hlr_db(pid=12363): Launched 17:40:46.288257 bus /sierra_2: Setting Powered False 17:40:47.350671 run create_hlr_db(pid=12363): Terminated: ok {rc=0} 17:40:47.777792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12365): Launched 17:40:48.086437 run osmo-hlr_10.42.42.2(pid=12366): Launched 17:40:48.204366 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:48.735865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12368): Launched 17:40:49.043227 run osmo-stp_10.42.42.5(pid=12369): Launched 17:40:49.161409 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:49.716020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12371): Launched 17:40:50.023780 run osmo-msc_10.42.42.6(pid=12372): Launched 17:40:50.194828 run osmo-stp_10.42.42.5(pid=12369): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12369)] 17:40:50.324162 run osmo-stp_10.42.42.5(pid=12369): stdout: | (launched: 2022-12-13_17:40:48.987028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:50.453842 run osmo-stp_10.42.42.5(pid=12369): stderr: | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174049154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:50.581433 run osmo-stp_10.42.42.5(pid=12369): stdout: | (launched: 2022-12-13_17:40:48.987028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:50.702996 run osmo-stp_10.42.42.5(pid=12369): stderr: | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174049153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174049154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174049154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:50.848433 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12369): Process ended prematurely: osmo-stp_10.42.42.5(pid=12369) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12369)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:40:50.857537 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:40:50.883664 run osmo-hlr_10.42.42.2(pid=12366): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12366)] 17:40:50.931683 run osmo-hlr_10.42.42.2(pid=12366): stdout: | (launched: 2022-12-13_17:40:48.029822) 17:40:50.981378 run osmo-hlr_10.42.42.2(pid=12366): stderr: | [0;m[1;31m20221213174048204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174048204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174048204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174048205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174048205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174048205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174048217 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174048225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174048226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174048226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:51.050656 run osmo-msc_10.42.42.6(pid=12372): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12372)] 17:40:51.098826 run osmo-msc_10.42.42.6(pid=12372): stdout: | (launched: 2022-12-13_17:40:49.967218) 17:40:51.148270 run osmo-msc_10.42.42.6(pid=12372): stderr: | [0;m[38;5;43m20221213174050238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174050238 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe13c097c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174050238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174050238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174050239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174050239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174050241 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174050241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174050241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174050241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:51.198033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12365): Terminating (SIGTERM) 17:40:51.237644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12368): Terminating (SIGTERM) 17:40:51.277349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12371): Terminating (SIGTERM) 17:40:51.317218 --- ParallelTerminationStrategy: PID 12365 died... 17:40:51.336301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12365): Terminated: ok {rc=0} 17:40:51.380859 --- ParallelTerminationStrategy: PID 12368 died... 17:40:51.399646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12368): Terminated: ok {rc=0} 17:40:51.443685 --- ParallelTerminationStrategy: PID 12371 died... 17:40:51.462369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12371): Terminated: ok {rc=0} 17:40:51.545913 bus /sierra_3: Setting Powered False 17:40:52.641795 bus /sierra_3: Setting Powered False 17:40:53.757122 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:40:55.012263 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:55.018034 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:40:55.051271 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:40:55.077862 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:40:55.128101 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:40:55.162575 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:40:55.189107 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:40:55.741974 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:40:55.792172 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:55.803315 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:40:55.877149 tst mo_mt_call.py: using LAC 35198 17:40:55.996308 tst mo_mt_call.py: using RAC 8 17:40:56.116400 tst mo_mt_call.py: using CellId 35198 17:40:56.236563 tst mo_mt_call.py: using BVCI 35199 17:40:56.358076 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:56.369722 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:56.381306 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:56.392744 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:56.404659 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:56.416559 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:56.534113 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:56.654636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:57.129432 run create_hlr_db(pid=12377): Launched 17:40:57.255177 bus /sierra_2: Setting Powered False 17:40:58.316855 run create_hlr_db(pid=12377): Terminated: ok {rc=0} 17:40:58.744296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12379): Launched 17:40:59.051299 run osmo-hlr_10.42.42.2(pid=12380): Launched 17:40:59.167926 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:59.713134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12382): Launched 17:41:00.020326 run osmo-stp_10.42.42.5(pid=12383): Launched 17:41:00.136364 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:00.692837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12385): Launched 17:41:01.013035 run osmo-msc_10.42.42.6(pid=12386): Launched 17:41:01.448779 run osmo-stp_10.42.42.5(pid=12383): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12383)] 17:41:01.722621 run osmo-stp_10.42.42.5(pid=12383): stdout: | (launched: 2022-12-13_17:40:59.963904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:01.917768 run osmo-stp_10.42.42.5(pid=12383): stderr: | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174100135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:02.068578 run osmo-stp_10.42.42.5(pid=12383): stdout: | (launched: 2022-12-13_17:40:59.963904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:02.206642 run osmo-stp_10.42.42.5(pid=12383): stderr: | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174100134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174100135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174100135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:02.370528 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12383): Process ended prematurely: osmo-stp_10.42.42.5(pid=12383) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12383)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:41:02.380795 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:41:02.410046 run osmo-hlr_10.42.42.2(pid=12380): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12380)] 17:41:02.465636 run osmo-hlr_10.42.42.2(pid=12380): stdout: | (launched: 2022-12-13_17:40:58.995063) 17:41:02.519140 run osmo-hlr_10.42.42.2(pid=12380): stderr: | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174059169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174059181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174059189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174059190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174059190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:02.593708 run osmo-msc_10.42.42.6(pid=12386): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12386)] 17:41:02.644922 run osmo-msc_10.42.42.6(pid=12386): stdout: | (launched: 2022-12-13_17:41:00.951482) 17:41:02.698728 run osmo-msc_10.42.42.6(pid=12386): stderr: | [0;m[38;5;43m20221213174101508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174101509 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80afdb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174101509 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174101509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174101510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174101511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174101515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174101515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174101516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174101516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:02.751889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12379): Terminating (SIGTERM) 17:41:02.794945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12382): Terminating (SIGTERM) 17:41:02.838517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12385): Terminating (SIGTERM) 17:41:02.882146 --- ParallelTerminationStrategy: PID 12379 died... 17:41:02.903232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12379): Terminated: ok {rc=0} 17:41:02.951076 --- ParallelTerminationStrategy: PID 12382 died... 17:41:02.971686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12382): Terminated: ok {rc=0} 17:41:03.019602 --- ParallelTerminationStrategy: PID 12385 died... 17:41:03.040402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12385): Terminated: ok {rc=0} 17:41:03.131705 bus /sierra_3: Setting Powered False 17:41:04.230278 bus /sierra_3: Setting Powered False 17:41:05.349284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:41:06.494469 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:06.506416 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:41:06.577440 tst mo_mt_call_osmux.py: using LAC 35199 17:41:06.700258 tst mo_mt_call_osmux.py: using RAC 9 17:41:06.821685 tst mo_mt_call_osmux.py: using CellId 35199 17:41:06.942388 tst mo_mt_call_osmux.py: using BVCI 35200 17:41:07.055134 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:07.066265 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:07.077352 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:07.088397 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:07.099562 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:41:07.110583 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:41:07.231770 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:41:07.355013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:07.828386 run create_hlr_db(pid=12388): Launched 17:41:07.953866 bus /sierra_2: Setting Powered False 17:41:09.014636 run create_hlr_db(pid=12388): Terminated: ok {rc=0} 17:41:09.442248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Launched 17:41:09.747871 run osmo-hlr_10.42.42.2(pid=12391): Launched 17:41:09.864144 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:10.402381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Launched 17:41:10.708309 run osmo-stp_10.42.42.5(pid=12394): Launched 17:41:10.824487 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:11.379747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12396): Launched 17:41:11.686441 run osmo-msc_10.42.42.6(pid=12397): Launched 17:41:11.858780 run osmo-stp_10.42.42.5(pid=12394): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] 17:41:11.987730 run osmo-stp_10.42.42.5(pid=12394): stdout: | (launched: 2022-12-13_17:41:10.652200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:12.117433 run osmo-stp_10.42.42.5(pid=12394): stderr: | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174110822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:12.245194 run osmo-stp_10.42.42.5(pid=12394): stdout: | (launched: 2022-12-13_17:41:10.652200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:12.366496 run osmo-stp_10.42.42.5(pid=12394): stderr: | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174110821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174110822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174110822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:12.512199 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12394): Process ended prematurely: osmo-stp_10.42.42.5(pid=12394) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:41:12.521388 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:41:12.547766 run osmo-hlr_10.42.42.2(pid=12391): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12391)] 17:41:12.595725 run osmo-hlr_10.42.42.2(pid=12391): stdout: | (launched: 2022-12-13_17:41:09.691893) 17:41:12.645327 run osmo-hlr_10.42.42.2(pid=12391): stderr: | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174109864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174109876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174109885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174109885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174109885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:12.714780 run osmo-msc_10.42.42.6(pid=12397): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12397)] 17:41:12.762519 run osmo-msc_10.42.42.6(pid=12397): stdout: | (launched: 2022-12-13_17:41:11.629835) 17:41:12.812196 run osmo-msc_10.42.42.6(pid=12397): stderr: | [0;m[38;5;43m20221213174111899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174111900 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc5ff4c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174111900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174111900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174111900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174111900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174111902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174111902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174111903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174111903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:12.862142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Terminating (SIGTERM) 17:41:12.901970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Terminating (SIGTERM) 17:41:12.941701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12396): Terminating (SIGTERM) 17:41:12.981659 --- ParallelTerminationStrategy: PID 12390 died... 17:41:13.000884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Terminated: ok {rc=0} 17:41:13.045385 --- ParallelTerminationStrategy: PID 12393 died... 17:41:13.064140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Terminated: ok {rc=0} 17:41:13.108210 --- ParallelTerminationStrategy: PID 12396 died... 17:41:13.126794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12396): Terminated: ok {rc=0} 17:41:13.212697 bus /sierra_3: Setting Powered False 17:41:14.311796 bus /sierra_3: Setting Powered False 17:41:15.425458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 17:41:16.684815 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:41:16.691514 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:41:16.732706 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:41:16.763920 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:41:16.855448 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:41:16.897716 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:41:16.931197 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:41:17.504214 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 17:41:17.510706 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:17.522155 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:17.575829 tst emergency_mo_mt_call.py: using LAC 35200 17:41:17.701904 tst emergency_mo_mt_call.py: using RAC 10 17:41:17.829362 tst emergency_mo_mt_call.py: using CellId 35200 17:41:17.954364 tst emergency_mo_mt_call.py: using BVCI 35201 17:41:18.070821 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:18.082210 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:18.093362 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:18.104399 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:18.115843 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:18.127421 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:18.248849 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:18.368437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:18.865973 run create_hlr_db(pid=12402): Launched 17:41:18.988399 bus /sierra_2: Setting Powered False 17:41:20.052650 run create_hlr_db(pid=12402): Terminated: ok {rc=0} 17:41:20.483528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Launched 17:41:20.784244 run osmo-hlr_10.42.42.2(pid=12405): Launched 17:41:20.897664 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:21.431578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Launched 17:41:21.731998 run osmo-stp_10.42.42.5(pid=12408): Launched 17:41:21.870462 tst emergency_mo_mt_call.py: using MSISDN 8251 17:41:22.036759 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:22.617224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12410): Launched 17:41:22.939275 run osmo-msc_10.42.42.6(pid=12411): Launched 17:41:23.117661 run osmo-stp_10.42.42.5(pid=12408): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] 17:41:23.253829 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-13_17:41:21.676010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:23.390998 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174121859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174121859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174121859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174121860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:23.525931 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-13_17:41:21.676010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:23.654505 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174121858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174121859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174121859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174121859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174121860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:23.808084 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 17:41:23.817305 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 17:41:23.844842 run osmo-hlr_10.42.42.2(pid=12405): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12405)] 17:41:23.896187 run osmo-hlr_10.42.42.2(pid=12405): stdout: | (launched: 2022-12-13_17:41:20.728798) 17:41:23.949221 run osmo-hlr_10.42.42.2(pid=12405): stderr: | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174120900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174120912 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174120923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174120923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174120923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:24.022341 run osmo-msc_10.42.42.6(pid=12411): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12411)] 17:41:24.072717 run osmo-msc_10.42.42.6(pid=12411): stdout: | (launched: 2022-12-13_17:41:22.879048) 17:41:24.125636 run osmo-msc_10.42.42.6(pid=12411): stderr: | [0;m[38;5;43m20221213174123197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174123197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3a3525c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174123197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174123197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174123198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174123198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174123199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174123200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174123200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174123200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:24.178449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminating (SIGTERM) 17:41:24.220721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminating (SIGTERM) 17:41:24.263830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12410): Terminating (SIGTERM) 17:41:24.306675 --- ParallelTerminationStrategy: PID 12404 died... 17:41:24.327248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminated: ok {rc=0} 17:41:24.374576 --- ParallelTerminationStrategy: PID 12407 died... 17:41:24.394739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminated: ok {rc=0} 17:41:24.441646 --- ParallelTerminationStrategy: PID 12410 died... 17:41:24.461646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12410): Terminated: ok {rc=0} 17:41:24.550304 bus /sierra_3: Setting Powered False 17:41:25.649585 bus /sierra_3: Setting Powered False 17:41:26.769947 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 17:41:27.858706 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:27.870835 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:27.923133 tst emergency_preemptive_call.py: using LAC 35201 17:41:28.046235 tst emergency_preemptive_call.py: using RAC 11 17:41:28.166459 tst emergency_preemptive_call.py: using CellId 35201 17:41:28.288169 tst emergency_preemptive_call.py: using BVCI 35202 17:41:28.407322 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:28.418908 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:28.430627 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:28.441813 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:28.453279 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:28.464587 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.582884 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.699591 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.814843 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.934063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:29.402732 run create_hlr_db(pid=12413): Launched 17:41:29.527586 bus /sierra_2: Setting Powered False 17:41:30.587863 run create_hlr_db(pid=12413): Terminated: ok {rc=0} 17:41:31.053817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12415): Launched 17:41:31.375275 run osmo-hlr_10.42.42.2(pid=12416): Launched 17:41:31.603948 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:32.250289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12418): Launched 17:41:32.554555 run osmo-stp_10.42.42.5(pid=12419): Launched 17:41:32.679320 tst emergency_preemptive_call.py: using MSISDN 8252 17:41:32.843559 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:33.383972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12421): Launched 17:41:33.684148 run osmo-msc_10.42.42.6(pid=12422): Launched 17:41:33.851125 run osmo-stp_10.42.42.5(pid=12419): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12419)] 17:41:33.978186 run osmo-stp_10.42.42.5(pid=12419): stdout: | (launched: 2022-12-13_17:41:32.499202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:34.105699 run osmo-stp_10.42.42.5(pid=12419): stderr: | [0;m[38;5;43m20221213174132665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174132666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174132666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174132666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:34.230851 run osmo-stp_10.42.42.5(pid=12419): stdout: | (launched: 2022-12-13_17:41:32.499202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:34.350418 run osmo-stp_10.42.42.5(pid=12419): stderr: | [0;m[38;5;43m20221213174132665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174132666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174132666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174132666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174132667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:34.493096 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12419): Process ended prematurely: osmo-stp_10.42.42.5(pid=12419) [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12419)] [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 17:41:34.501699 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:41:34.527879 run osmo-hlr_10.42.42.2(pid=12416): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12416)] 17:41:34.576486 run osmo-hlr_10.42.42.2(pid=12416): stdout: | (launched: 2022-12-13_17:41:31.313150) 17:41:34.626745 run osmo-hlr_10.42.42.2(pid=12416): stderr: | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174131553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174131570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174131590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174131590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174131590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:34.696505 run osmo-msc_10.42.42.6(pid=12422): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12422)] 17:41:34.744734 run osmo-msc_10.42.42.6(pid=12422): stdout: | (launched: 2022-12-13_17:41:33.628858) 17:41:34.794534 run osmo-msc_10.42.42.6(pid=12422): stderr: | [0;m[38;5;43m20221213174133896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174133897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ed876fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174133897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174133897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174133897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174133897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174133899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174133900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174133900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174133900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:34.844652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12415): Terminating (SIGTERM) 17:41:34.884823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12418): Terminating (SIGTERM) 17:41:34.926890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12421): Terminating (SIGTERM) 17:41:34.967447 --- ParallelTerminationStrategy: PID 12415 died... 17:41:34.986946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12415): Terminated: ok {rc=0} 17:41:35.031508 --- ParallelTerminationStrategy: PID 12418 died... 17:41:35.050424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12418): Terminated: ok {rc=0} 17:41:35.094679 --- ParallelTerminationStrategy: PID 12421 died... 17:41:35.113634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12421): Terminated: ok {rc=0} 17:41:35.199966 bus /sierra_9: Setting Powered False 17:41:36.301774 bus /sierra_9: Setting Powered False 17:41:37.418193 bus /sierra_8: Setting Powered False 17:41:38.518102 bus /sierra_8: Setting Powered False 17:41:39.635390 bus /sierra_3: Setting Powered False 17:41:40.735333 bus /sierra_3: Setting Powered False 17:41:41.852856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 17:41:43.135714 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:41:43.141969 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:41:43.176879 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 17:41:43.217155 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:41:43.308123 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:41:43.344397 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 17:41:43.384456 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:41:43.973678 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 17:41:44.025459 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.036251 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:44.085025 tst cs_paging_gprs_active.py: using LAC 35202 17:41:44.206528 tst cs_paging_gprs_active.py: using RAC 12 17:41:44.328262 tst cs_paging_gprs_active.py: using CellId 35202 17:41:44.450842 tst cs_paging_gprs_active.py: using BVCI 35203 17:41:44.563136 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.573967 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.584474 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.595009 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.605620 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.616060 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.627194 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.638061 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:44.649045 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:44.766653 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:44.888100 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:41:45.110137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:45.440781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12428): Launched 17:41:45.728287 run iperf3-srv_10.42.42.10(pid=12429): Launched 17:41:45.876044 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:41:46.091117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:46.410316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12430): Launched 17:41:46.703371 run iperf3-srv_10.42.42.10(pid=12431): Launched 17:41:46.835313 tst cs_paging_gprs_active.py:38: start network... 17:41:47.045992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:47.526231 run create_hlr_db(pid=12432): Launched 17:41:47.652548 bus /sierra_2: Setting Powered False 17:41:48.714063 run create_hlr_db(pid=12432): Terminated: ok {rc=0} 17:41:49.163257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Launched 17:41:49.495564 run osmo-hlr_10.42.42.2(pid=12435): Launched 17:41:49.622305 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:50.192127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Launched 17:41:50.522115 run osmo-stp_10.42.42.5(pid=12438): Launched 17:41:50.646991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:51.213765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12440): Launched 17:41:51.340896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:51.620580 run patchelf(pid=12441): Launched 17:41:51.804298 run osmo-stp_10.42.42.5(pid=12438): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] 17:41:51.944455 run osmo-stp_10.42.42.5(pid=12438): stdout: | (launched: 2022-12-13_17:41:50.462277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:52.086384 run osmo-stp_10.42.42.5(pid=12438): stderr: | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174150652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:52.228356 run osmo-stp_10.42.42.5(pid=12438): stdout: | (launched: 2022-12-13_17:41:50.462277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:52.363517 run osmo-stp_10.42.42.5(pid=12438): stderr: | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174150651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174150652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174150652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:52.524150 run patchelf(pid=12441): Terminating (SIGINT) 17:41:52.711532 run patchelf(pid=12441): Terminated: ok {rc=0} 17:41:52.846375 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12438): Process ended prematurely: osmo-stp_10.42.42.5(pid=12438) [trial-2392↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] [trial-2392↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 17:41:52.856886 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:41:52.885661 run osmo-hlr_10.42.42.2(pid=12435): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12435)] 17:41:52.937214 run osmo-hlr_10.42.42.2(pid=12435): stdout: | (launched: 2022-12-13_17:41:49.435566) 17:41:52.990266 run osmo-hlr_10.42.42.2(pid=12435): stderr: | [0;m[1;31m20221213174149633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174149633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174149634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174149634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174149634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174149634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174149647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174149657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174149657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174149657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:53.043420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12428): Terminating (SIGTERM) 17:41:53.085901 run iperf3-srv_10.42.42.10(pid=12429): Terminating (SIGTERM) 17:41:53.128545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12430): Terminating (SIGTERM) 17:41:53.171337 run iperf3-srv_10.42.42.10(pid=12431): Terminating (SIGTERM) 17:41:53.213911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Terminating (SIGTERM) 17:41:53.256654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Terminating (SIGTERM) 17:41:53.299353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12440): Terminating (SIGTERM) 17:41:53.342266 --- ParallelTerminationStrategy: PID 12428 died... 17:41:53.363022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12428): Terminated: ok {rc=0} 17:41:53.410700 --- ParallelTerminationStrategy: PID 12429 died... 17:41:53.431113 run iperf3-srv_10.42.42.10(pid=12429): Terminated {rc=256} 17:41:53.478065 --- ParallelTerminationStrategy: PID 12430 died... 17:41:53.498137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12430): Terminated: ok {rc=0} 17:41:53.545401 --- ParallelTerminationStrategy: PID 12431 died... 17:41:53.565511 run iperf3-srv_10.42.42.10(pid=12431): Terminated {rc=256} 17:41:53.612446 --- ParallelTerminationStrategy: PID 12434 died... 17:41:53.632489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Terminated: ok {rc=0} 17:41:53.679436 --- ParallelTerminationStrategy: PID 12437 died... 17:41:53.699421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Terminated: ok {rc=0} 17:41:53.746046 --- ParallelTerminationStrategy: PID 12440 died... 17:41:53.766339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12440): Terminated: ok {rc=0} 17:41:53.855555 bus /gobi_0: Setting Powered False 17:41:54.955141 bus /gobi_0: Setting Powered False 17:41:56.074471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 17:41:57.221262 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.232732 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:57.284730 tst iperf3.py: using LAC 35203 17:41:57.409483 tst iperf3.py: using RAC 13 17:41:57.529042 tst iperf3.py: using CellId 35203 17:41:57.648144 tst iperf3.py: using BVCI 35204 17:41:57.759139 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.770051 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.780501 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.791072 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.801656 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.811996 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.823351 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.833902 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:57.844648 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:57.962499 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:41:58.169392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:58.478607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Launched 17:41:58.747114 run iperf3-srv_10.42.42.10(pid=12443): Launched 17:41:58.862727 tst iperf3.py:8: start network... 17:41:59.068463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:59.545381 run create_hlr_db(pid=12444): Launched 17:41:59.671844 bus /gobi_6: Setting Powered False 17:42:00.733867 run create_hlr_db(pid=12444): Terminated: ok {rc=0} 17:42:01.227126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Launched 17:42:01.555645 run osmo-hlr_10.42.42.2(pid=12450): Launched 17:42:01.795969 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:02.508900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Launched 17:42:02.817087 run osmo-stp_10.42.42.5(pid=12453): Launched 17:42:02.934552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:03.467242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Launched 17:42:03.585431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:03.848286 run patchelf(pid=12456): Launched 17:42:04.020433 run osmo-stp_10.42.42.5(pid=12453): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] 17:42:04.151493 run osmo-stp_10.42.42.5(pid=12453): stdout: | (launched: 2022-12-13_17:42:02.760221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:04.283883 run osmo-stp_10.42.42.5(pid=12453): stderr: | [0;m[38;5;43m20221213174202929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174202929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174202930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174202930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:04.416460 run osmo-stp_10.42.42.5(pid=12453): stdout: | (launched: 2022-12-13_17:42:02.760221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:04.542730 run osmo-stp_10.42.42.5(pid=12453): stderr: | [0;m[38;5;43m20221213174202929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174202929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174202930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174202930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174202931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:04.692130 run patchelf(pid=12456): Terminating (SIGINT) 17:42:04.868052 run patchelf(pid=12456): Terminated: ok {rc=0} 17:42:04.994778 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12453): Process ended prematurely: osmo-stp_10.42.42.5(pid=12453) [trial-2392↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] [trial-2392↪gprs:trx-sysmocell5000↪iperf3.py:8] 17:42:05.004254 tst iperf3.py:8: Test FAILED (7.8 sec) 17:42:05.031685 run osmo-hlr_10.42.42.2(pid=12450): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12450)] 17:42:05.080097 run osmo-hlr_10.42.42.2(pid=12450): stdout: | (launched: 2022-12-13_17:42:01.495158) 17:42:05.130111 run osmo-hlr_10.42.42.2(pid=12450): stderr: | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174201833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174201849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174201865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174201866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174201866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:05.180541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Terminating (SIGTERM) 17:42:05.221082 run iperf3-srv_10.42.42.10(pid=12443): Terminating (SIGTERM) 17:42:05.261370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Terminating (SIGTERM) 17:42:05.301820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Terminating (SIGTERM) 17:42:05.342353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Terminating (SIGTERM) 17:42:05.383042 --- ParallelTerminationStrategy: PID 12442 died... 17:42:05.402438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Terminated: ok {rc=0} 17:42:05.447002 --- ParallelTerminationStrategy: PID 12443 died... 17:42:05.465855 run iperf3-srv_10.42.42.10(pid=12443): Terminated {rc=256} 17:42:05.510090 --- ParallelTerminationStrategy: PID 12449 died... 17:42:05.528909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Terminated: ok {rc=0} 17:42:05.573196 --- ParallelTerminationStrategy: PID 12452 died... 17:42:05.592025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Terminated: ok {rc=0} 17:42:05.636706 --- ParallelTerminationStrategy: PID 12455 died... 17:42:05.655613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Terminated: ok {rc=0} 17:42:05.741243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 17:42:06.887482 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:06.898948 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:06.948332 tst iperf3m4.py: using LAC 35204 17:42:07.069214 tst iperf3m4.py: using RAC 14 17:42:07.188904 tst iperf3m4.py: using CellId 35204 17:42:07.309625 tst iperf3m4.py: using BVCI 35205 17:42:07.421346 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.432097 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.442688 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.453256 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.463747 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.474734 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.485906 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.496384 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:07.507085 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:07.630084 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:07.750809 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:07.869533 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:07.990321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:08.212938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:08.543777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Launched 17:42:08.832534 run iperf3-srv_10.42.42.10(pid=12458): Launched 17:42:08.955699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:42:09.177981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:09.508805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Launched 17:42:09.795360 run iperf3-srv_10.42.42.10(pid=12460): Launched 17:42:09.920022 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:42:10.142171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:10.473454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Launched 17:42:10.761071 run iperf3-srv_10.42.42.10(pid=12462): Launched 17:42:10.884202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:42:11.106607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:11.437833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Launched 17:42:11.724910 run iperf3-srv_10.42.42.10(pid=12464): Launched 17:42:11.847868 tst iperf3m4.py:8: start network... 17:42:12.069741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:12.578726 run create_hlr_db(pid=12465): Launched 17:42:12.705260 bus /gobi_6: Setting Powered False 17:42:13.770215 run create_hlr_db(pid=12465): Terminated: ok {rc=0} 17:42:14.209645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Launched 17:42:14.518534 run osmo-hlr_10.42.42.2(pid=12468): Launched 17:42:14.636185 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:15.166510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Launched 17:42:15.474667 run osmo-stp_10.42.42.5(pid=12471): Launched 17:42:15.592582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:16.175552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Launched 17:42:16.307668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:16.574181 run patchelf(pid=12474): Launched 17:42:16.762744 run osmo-stp_10.42.42.5(pid=12471): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] 17:42:16.896095 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-13_17:42:15.417778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:17.030917 run osmo-stp_10.42.42.5(pid=12471): stderr: | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174215587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:17.165707 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-13_17:42:15.417778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:17.309878 run osmo-stp_10.42.42.5(pid=12471): stderr: | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174215587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174215587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174215588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:17.482192 run patchelf(pid=12474): Terminating (SIGINT) 17:42:17.670601 run patchelf(pid=12474): Terminated: ok {rc=0} 17:42:17.806557 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2392↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] [trial-2392↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 17:42:17.817307 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:42:17.846753 run osmo-hlr_10.42.42.2(pid=12468): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12468)] 17:42:17.900463 run osmo-hlr_10.42.42.2(pid=12468): stdout: | (launched: 2022-12-13_17:42:14.461930) 17:42:17.953991 run osmo-hlr_10.42.42.2(pid=12468): stderr: | [0;m[1;31m20221213174214635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174214635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174214635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174214635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174214636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174214636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174214648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174214658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174214658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174214658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:18.007822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Terminating (SIGTERM) 17:42:18.050562 run iperf3-srv_10.42.42.10(pid=12458): Terminating (SIGTERM) 17:42:18.093993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Terminating (SIGTERM) 17:42:18.137363 run iperf3-srv_10.42.42.10(pid=12460): Terminating (SIGTERM) 17:42:18.180722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Terminating (SIGTERM) 17:42:18.224297 run iperf3-srv_10.42.42.10(pid=12462): Terminating (SIGTERM) 17:42:18.267704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Terminating (SIGTERM) 17:42:18.311556 run iperf3-srv_10.42.42.10(pid=12464): Terminating (SIGTERM) 17:42:18.354869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Terminating (SIGTERM) 17:42:18.398574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminating (SIGTERM) 17:42:18.442200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminating (SIGTERM) 17:42:18.486010 --- ParallelTerminationStrategy: PID 12457 died... 17:42:18.507406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Terminated: ok {rc=0} 17:42:18.555464 --- ParallelTerminationStrategy: PID 12458 died... 17:42:18.576246 run iperf3-srv_10.42.42.10(pid=12458): Terminated {rc=256} 17:42:18.624186 --- ParallelTerminationStrategy: PID 12459 died... 17:42:18.645051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Terminated: ok {rc=0} 17:42:18.692818 --- ParallelTerminationStrategy: PID 12460 died... 17:42:18.714069 run iperf3-srv_10.42.42.10(pid=12460): Terminated {rc=256} 17:42:18.761845 --- ParallelTerminationStrategy: PID 12461 died... 17:42:18.782799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Terminated: ok {rc=0} 17:42:18.830624 --- ParallelTerminationStrategy: PID 12462 died... 17:42:18.851332 run iperf3-srv_10.42.42.10(pid=12462): Terminated {rc=256} 17:42:18.899100 --- ParallelTerminationStrategy: PID 12463 died... 17:42:18.920019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Terminated: ok {rc=0} 17:42:18.967840 --- ParallelTerminationStrategy: PID 12464 died... 17:42:18.988529 run iperf3-srv_10.42.42.10(pid=12464): Terminated {rc=256} 17:42:19.036192 --- ParallelTerminationStrategy: PID 12467 died... 17:42:19.057273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Terminated: ok {rc=0} 17:42:19.105314 --- ParallelTerminationStrategy: PID 12470 died... 17:42:19.126273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminated: ok {rc=0} 17:42:19.174331 --- ParallelTerminationStrategy: PID 12473 died... 17:42:19.195225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminated: ok {rc=0} 17:42:19.286492 bus /gobi_4: Setting Powered False 17:42:20.386901 bus /gobi_4: Setting Powered False 17:42:21.505341 bus /gobi_1: Setting Powered False 17:42:22.605552 bus /gobi_1: Setting Powered False 17:42:23.722726 bus /gobi_0: Setting Powered False 17:42:24.821296 bus /gobi_0: Setting Powered False 17:42:25.939657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 17:42:27.043937 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.055957 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:27.108484 tst ping.py: using LAC 35205 17:42:27.236183 tst ping.py: using RAC 15 17:42:27.362391 tst ping.py: using CellId 35205 17:42:27.492361 tst ping.py: using BVCI 35206 17:42:27.611959 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.623252 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.634320 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.645326 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.656543 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.667880 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.679337 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:27.690679 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:27.809063 tst ping.py:19: start network... 17:42:28.012073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:28.477244 run create_hlr_db(pid=12475): Launched 17:42:28.605446 bus /gobi_6: Setting Powered False 17:42:29.669813 run create_hlr_db(pid=12475): Terminated: ok {rc=0} 17:42:30.102220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12477): Launched 17:42:30.403164 run osmo-hlr_10.42.42.2(pid=12478): Launched 17:42:30.516666 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:31.105785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12480): Launched 17:42:31.414987 run osmo-stp_10.42.42.5(pid=12481): Launched 17:42:31.656804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:32.410274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12483): Launched 17:42:32.534565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:32.808422 run patchelf(pid=12484): Launched 17:42:32.987976 run osmo-stp_10.42.42.5(pid=12481): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12481)] 17:42:33.125415 run osmo-stp_10.42.42.5(pid=12481): stdout: | (launched: 2022-12-13_17:42:31.358707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:33.264376 run osmo-stp_10.42.42.5(pid=12481): stderr: | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174231684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:33.403977 run osmo-stp_10.42.42.5(pid=12481): stdout: | (launched: 2022-12-13_17:42:31.358707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:33.537205 run osmo-stp_10.42.42.5(pid=12481): stderr: | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174231683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174231684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174231684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:33.694393 run patchelf(pid=12484): Terminating (SIGINT) 17:42:33.877345 run patchelf(pid=12484): Terminated: ok {rc=0} 17:42:34.009385 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12481): Process ended prematurely: osmo-stp_10.42.42.5(pid=12481) [trial-2392↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12481)] [trial-2392↪gprs:trx-sysmocell5000↪ping.py:22] 17:42:34.019048 tst ping.py:22: Test FAILED (7.0 sec) 17:42:34.047501 run osmo-hlr_10.42.42.2(pid=12478): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12478)] 17:42:34.100069 run osmo-hlr_10.42.42.2(pid=12478): stdout: | (launched: 2022-12-13_17:42:30.347383) 17:42:34.153478 run osmo-hlr_10.42.42.2(pid=12478): stderr: | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174230520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174230533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174230545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174230545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174230545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:34.207221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12477): Terminating (SIGTERM) 17:42:34.249907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12480): Terminating (SIGTERM) 17:42:34.293095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12483): Terminating (SIGTERM) 17:42:34.336520 --- ParallelTerminationStrategy: PID 12477 died... 17:42:34.357638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12477): Terminated: ok {rc=0} 17:42:34.405868 --- ParallelTerminationStrategy: PID 12480 died... 17:42:34.426573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12480): Terminated: ok {rc=0} 17:42:34.474374 --- ParallelTerminationStrategy: PID 12483 died... 17:42:34.494946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12483): Terminated: ok {rc=0} 17:42:34.584918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 17:42:35.675394 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:35.687440 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:35.738939 tst ping_idle_ping.py: using LAC 35206 17:42:35.867888 tst ping_idle_ping.py: using RAC 16 17:42:35.994302 tst ping_idle_ping.py: using CellId 35206 17:42:36.122805 tst ping_idle_ping.py: using BVCI 35207 17:42:36.240411 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.251803 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.262884 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.274078 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.285611 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.297205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.308923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:36.320540 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:36.439194 tst ping_idle_ping.py:24: start network... 17:42:36.642468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:37.112617 run create_hlr_db(pid=12485): Launched 17:42:37.236073 bus /gobi_6: Setting Powered False 17:42:38.297109 run create_hlr_db(pid=12485): Terminated: ok {rc=0} 17:42:38.740300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Launched 17:42:39.064185 run osmo-hlr_10.42.42.2(pid=12488): Launched 17:42:39.187945 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:39.747534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Launched 17:42:40.073095 run osmo-stp_10.42.42.5(pid=12491): Launched 17:42:40.196131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:40.753641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12493): Launched 17:42:40.879359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:41.154186 run patchelf(pid=12494): Launched 17:42:41.335518 run osmo-stp_10.42.42.5(pid=12491): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] 17:42:41.473430 run osmo-stp_10.42.42.5(pid=12491): stdout: | (launched: 2022-12-13_17:42:40.013727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:41.612863 run osmo-stp_10.42.42.5(pid=12491): stderr: | [0;m[38;5;43m20221213174240202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174240202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174240203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174240203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:41.752409 run osmo-stp_10.42.42.5(pid=12491): stdout: | (launched: 2022-12-13_17:42:40.013727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:41.885852 run osmo-stp_10.42.42.5(pid=12491): stderr: | [0;m[38;5;43m20221213174240202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174240202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174240203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174240203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174240204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:42.044135 run patchelf(pid=12494): Terminating (SIGINT) 17:42:42.228091 run patchelf(pid=12494): Terminated: ok {rc=0} 17:42:42.360535 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12491): Process ended prematurely: osmo-stp_10.42.42.5(pid=12491) [trial-2392↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] [trial-2392↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 17:42:42.370103 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:42:42.398566 run osmo-hlr_10.42.42.2(pid=12488): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12488)] 17:42:42.450617 run osmo-hlr_10.42.42.2(pid=12488): stdout: | (launched: 2022-12-13_17:42:39.004832) 17:42:42.504281 run osmo-hlr_10.42.42.2(pid=12488): stderr: | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174239200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174239213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174239222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174239222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174239222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:42.557908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Terminating (SIGTERM) 17:42:42.600152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Terminating (SIGTERM) 17:42:42.643234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12493): Terminating (SIGTERM) 17:42:42.686490 --- ParallelTerminationStrategy: PID 12487 died... 17:42:42.707100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Terminated: ok {rc=0} 17:42:42.754029 --- ParallelTerminationStrategy: PID 12490 died... 17:42:42.774212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Terminated: ok {rc=0} 17:42:42.821254 --- ParallelTerminationStrategy: PID 12493 died... 17:42:42.841479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12493): Terminated: ok {rc=0} 17:42:42.931470 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 17:42:44.241398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:42:44.247313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:42:44.280444 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:42:44.318593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:42:44.405415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:42:44.438720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:42:44.476716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:42:45.072415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:42:45.122140 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.133230 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:45.183454 tst cs_paging_gprs_active.py: using LAC 35207 17:42:45.307366 tst cs_paging_gprs_active.py: using RAC 17 17:42:45.433328 tst cs_paging_gprs_active.py: using CellId 35207 17:42:45.553656 tst cs_paging_gprs_active.py: using BVCI 35208 17:42:45.675651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.687155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.698408 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.709678 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.721080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.732572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.745204 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.756592 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:45.768461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:45.898717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:46.026322 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:42:46.271392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:46.590647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Launched 17:42:46.866615 run iperf3-srv_10.42.42.10(pid=12499): Launched 17:42:46.998771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:42:47.209556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:47.521673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Launched 17:42:47.792730 run iperf3-srv_10.42.42.10(pid=12501): Launched 17:42:47.908650 tst cs_paging_gprs_active.py:38: start network... 17:42:48.116327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:48.594668 run create_hlr_db(pid=12502): Launched 17:42:48.722802 bus /gobi_6: Setting Powered False 17:42:49.783847 run create_hlr_db(pid=12502): Terminated: ok {rc=0} 17:42:50.235339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Launched 17:42:50.568508 run osmo-hlr_10.42.42.2(pid=12505): Launched 17:42:50.695271 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:51.263063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Launched 17:42:51.596307 run osmo-stp_10.42.42.5(pid=12508): Launched 17:42:51.724631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:52.294557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Launched 17:42:52.423791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:52.703551 run patchelf(pid=12511): Launched 17:42:52.888822 run osmo-stp_10.42.42.5(pid=12508): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] 17:42:53.028735 run osmo-stp_10.42.42.5(pid=12508): stdout: | (launched: 2022-12-13_17:42:51.535765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:53.170537 run osmo-stp_10.42.42.5(pid=12508): stderr: | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174251726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:53.312298 run osmo-stp_10.42.42.5(pid=12508): stdout: | (launched: 2022-12-13_17:42:51.535765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:53.448230 run osmo-stp_10.42.42.5(pid=12508): stderr: | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174251726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174251726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174251727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:53.608598 run patchelf(pid=12511): Terminating (SIGINT) 17:42:53.795687 run patchelf(pid=12511): Terminated: ok {rc=0} 17:42:53.931428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12508): Process ended prematurely: osmo-stp_10.42.42.5(pid=12508) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:42:53.941818 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:42:53.970578 run osmo-hlr_10.42.42.2(pid=12505): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12505)] 17:42:54.022157 run osmo-hlr_10.42.42.2(pid=12505): stdout: | (launched: 2022-12-13_17:42:50.508614) 17:42:54.075720 run osmo-hlr_10.42.42.2(pid=12505): stderr: | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174250704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174250750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174250760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174250760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174250761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:54.129595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Terminating (SIGTERM) 17:42:54.172196 run iperf3-srv_10.42.42.10(pid=12499): Terminating (SIGTERM) 17:42:54.215398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Terminating (SIGTERM) 17:42:54.258289 run iperf3-srv_10.42.42.10(pid=12501): Terminating (SIGTERM) 17:42:54.300787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Terminating (SIGTERM) 17:42:54.343606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Terminating (SIGTERM) 17:42:54.386313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Terminating (SIGTERM) 17:42:54.429593 --- ParallelTerminationStrategy: PID 12498 died... 17:42:54.450171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Terminated: ok {rc=0} 17:42:54.497624 --- ParallelTerminationStrategy: PID 12499 died... 17:42:54.517729 run iperf3-srv_10.42.42.10(pid=12499): Terminated {rc=256} 17:42:54.564885 --- ParallelTerminationStrategy: PID 12500 died... 17:42:54.585438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Terminated: ok {rc=0} 17:42:54.632358 --- ParallelTerminationStrategy: PID 12501 died... 17:42:54.652739 run iperf3-srv_10.42.42.10(pid=12501): Terminated {rc=256} 17:42:54.699565 --- ParallelTerminationStrategy: PID 12504 died... 17:42:54.719706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Terminated: ok {rc=0} 17:42:54.766540 --- ParallelTerminationStrategy: PID 12507 died... 17:42:54.786791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Terminated: ok {rc=0} 17:42:54.833809 --- ParallelTerminationStrategy: PID 12510 died... 17:42:54.853991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Terminated: ok {rc=0} 17:42:54.943692 bus /gobi_0: Setting Powered False 17:42:56.043640 bus /gobi_0: Setting Powered False 17:42:57.162435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:42:58.314747 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.327031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:58.382853 tst iperf3.py: using LAC 35208 17:42:58.512734 tst iperf3.py: using RAC 18 17:42:58.642318 tst iperf3.py: using CellId 35208 17:42:58.772827 tst iperf3.py: using BVCI 35209 17:42:58.892312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.903803 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.914972 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.926323 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.937946 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.949511 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.961350 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.972820 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:58.984634 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:59.106475 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:59.328280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:59.659026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Launched 17:42:59.945293 run iperf3-srv_10.42.42.10(pid=12513): Launched 17:43:00.068098 tst iperf3.py:8: start network... 17:43:00.291180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:00.801073 run create_hlr_db(pid=12514): Launched 17:43:00.936754 bus /gobi_6: Setting Powered False 17:43:01.998341 run create_hlr_db(pid=12514): Terminated: ok {rc=0} 17:43:02.439830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Launched 17:43:02.750596 run osmo-hlr_10.42.42.2(pid=12517): Launched 17:43:02.869871 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:03.418508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Launched 17:43:03.728317 run osmo-stp_10.42.42.5(pid=12520): Launched 17:43:03.845392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:04.376056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Launched 17:43:04.494128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:04.754232 run patchelf(pid=12523): Launched 17:43:04.925188 run osmo-stp_10.42.42.5(pid=12520): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] 17:43:05.055452 run osmo-stp_10.42.42.5(pid=12520): stdout: | (launched: 2022-12-13_17:43:03.671285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:05.187694 run osmo-stp_10.42.42.5(pid=12520): stderr: | [0;m[38;5;43m20221213174303839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174303840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174303840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174303840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:05.320096 run osmo-stp_10.42.42.5(pid=12520): stdout: | (launched: 2022-12-13_17:43:03.671285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:05.445838 run osmo-stp_10.42.42.5(pid=12520): stderr: | [0;m[38;5;43m20221213174303839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174303840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174303840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174303840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:05.594548 run patchelf(pid=12523): Terminating (SIGINT) 17:43:05.769231 run patchelf(pid=12523): Terminated: ok {rc=0} 17:43:05.895170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12520): Process ended prematurely: osmo-stp_10.42.42.5(pid=12520) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 17:43:05.904686 tst iperf3.py:8: Test FAILED (7.6 sec) 17:43:05.932003 run osmo-hlr_10.42.42.2(pid=12517): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12517)] 17:43:05.980227 run osmo-hlr_10.42.42.2(pid=12517): stdout: | (launched: 2022-12-13_17:43:02.694382) 17:43:06.030151 run osmo-hlr_10.42.42.2(pid=12517): stderr: | [0;m[1;31m20221213174302866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174302866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174302867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174302867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174302867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174302867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174302878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174302888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174302889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174302889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:06.080757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Terminating (SIGTERM) 17:43:06.121246 run iperf3-srv_10.42.42.10(pid=12513): Terminating (SIGTERM) 17:43:06.161595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Terminating (SIGTERM) 17:43:06.201646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Terminating (SIGTERM) 17:43:06.241688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Terminating (SIGTERM) 17:43:06.281845 --- ParallelTerminationStrategy: PID 12512 died... 17:43:06.300942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Terminated: ok {rc=0} 17:43:06.345138 --- ParallelTerminationStrategy: PID 12513 died... 17:43:06.364273 run iperf3-srv_10.42.42.10(pid=12513): Terminated {rc=256} 17:43:06.408152 --- ParallelTerminationStrategy: PID 12516 died... 17:43:06.426917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Terminated: ok {rc=0} 17:43:06.471037 --- ParallelTerminationStrategy: PID 12519 died... 17:43:06.489823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Terminated: ok {rc=0} 17:43:06.533967 --- ParallelTerminationStrategy: PID 12522 died... 17:43:06.552535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Terminated: ok {rc=0} 17:43:06.637186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:43:07.787683 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:07.799991 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:07.854642 tst iperf3m4.py: using LAC 35209 17:43:07.984004 tst iperf3m4.py: using RAC 19 17:43:08.114187 tst iperf3m4.py: using CellId 35209 17:43:08.237504 tst iperf3m4.py: using BVCI 35210 17:43:08.350016 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.361282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.372101 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.383278 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.394174 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.405062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.415905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.426624 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:08.437591 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:08.561085 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:08.683786 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:08.806587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:08.925660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:43:09.133211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:09.443232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Launched 17:43:09.712891 run iperf3-srv_10.42.42.10(pid=12525): Launched 17:43:09.828443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:43:10.034687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:10.346274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Launched 17:43:10.614786 run iperf3-srv_10.42.42.10(pid=12527): Launched 17:43:10.731153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:43:10.936849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:11.246237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Launched 17:43:11.515034 run iperf3-srv_10.42.42.10(pid=12529): Launched 17:43:11.630263 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:43:11.836016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:12.146924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Launched 17:43:12.434869 run iperf3-srv_10.42.42.10(pid=12531): Launched 17:43:12.560098 tst iperf3m4.py:8: start network... 17:43:12.782830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:13.292906 run create_hlr_db(pid=12532): Launched 17:43:13.419344 bus /gobi_6: Setting Powered False 17:43:14.484428 run create_hlr_db(pid=12532): Terminated: ok {rc=0} 17:43:14.943682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Launched 17:43:15.274196 run osmo-hlr_10.42.42.2(pid=12535): Launched 17:43:15.401832 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:15.982507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Launched 17:43:16.312918 run osmo-stp_10.42.42.5(pid=12538): Launched 17:43:16.585214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:17.220620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Launched 17:43:17.339388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:17.601255 run patchelf(pid=12541): Launched 17:43:17.773391 run osmo-stp_10.42.42.5(pid=12538): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] 17:43:17.904325 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-13_17:43:16.252083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:18.037140 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174316546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:18.169687 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-13_17:43:16.252083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:18.296606 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174316545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174316546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174316546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:18.445844 run patchelf(pid=12541): Terminating (SIGINT) 17:43:18.621700 run patchelf(pid=12541): Terminated: ok {rc=0} 17:43:18.748359 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 17:43:18.757927 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:43:18.785491 run osmo-hlr_10.42.42.2(pid=12535): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12535)] 17:43:18.834026 run osmo-hlr_10.42.42.2(pid=12535): stdout: | (launched: 2022-12-13_17:43:15.213457) 17:43:18.884471 run osmo-hlr_10.42.42.2(pid=12535): stderr: | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174315409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174315421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174315429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174315430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174315430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:18.935320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Terminating (SIGTERM) 17:43:18.975825 run iperf3-srv_10.42.42.10(pid=12525): Terminating (SIGTERM) 17:43:19.016013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Terminating (SIGTERM) 17:43:19.056471 run iperf3-srv_10.42.42.10(pid=12527): Terminating (SIGTERM) 17:43:19.096806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Terminating (SIGTERM) 17:43:19.137247 run iperf3-srv_10.42.42.10(pid=12529): Terminating (SIGTERM) 17:43:19.177473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminating (SIGTERM) 17:43:19.217863 run iperf3-srv_10.42.42.10(pid=12531): Terminating (SIGTERM) 17:43:19.258047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminating (SIGTERM) 17:43:19.298258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminating (SIGTERM) 17:43:19.338579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminating (SIGTERM) 17:43:19.379343 --- ParallelTerminationStrategy: PID 12524 died... 17:43:19.398961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Terminated: ok {rc=0} 17:43:19.443837 --- ParallelTerminationStrategy: PID 12525 died... 17:43:19.462907 run iperf3-srv_10.42.42.10(pid=12525): Terminated {rc=256} 17:43:19.507329 --- ParallelTerminationStrategy: PID 12526 died... 17:43:19.526484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Terminated: ok {rc=0} 17:43:19.571551 --- ParallelTerminationStrategy: PID 12527 died... 17:43:19.590824 run iperf3-srv_10.42.42.10(pid=12527): Terminated {rc=256} 17:43:19.635704 --- ParallelTerminationStrategy: PID 12528 died... 17:43:19.654855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Terminated: ok {rc=0} 17:43:19.699818 --- ParallelTerminationStrategy: PID 12529 died... 17:43:19.719120 run iperf3-srv_10.42.42.10(pid=12529): Terminated {rc=256} 17:43:19.764005 --- ParallelTerminationStrategy: PID 12530 died... 17:43:19.783224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminated: ok {rc=0} 17:43:19.828349 --- ParallelTerminationStrategy: PID 12531 died... 17:43:19.847608 run iperf3-srv_10.42.42.10(pid=12531): Terminated {rc=256} 17:43:19.892380 --- ParallelTerminationStrategy: PID 12534 died... 17:43:19.911585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminated: ok {rc=0} 17:43:19.956308 --- ParallelTerminationStrategy: PID 12537 died... 17:43:19.975376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminated: ok {rc=0} 17:43:20.020279 --- ParallelTerminationStrategy: PID 12540 died... 17:43:20.039639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminated: ok {rc=0} 17:43:20.127839 bus /gobi_4: Setting Powered False 17:43:21.229549 bus /gobi_4: Setting Powered False 17:43:22.344459 bus /gobi_1: Setting Powered False 17:43:23.444633 bus /gobi_1: Setting Powered False 17:43:24.563906 bus /gobi_0: Setting Powered False 17:43:25.665316 bus /gobi_0: Setting Powered False 17:43:26.784986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 17:43:27.890255 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:27.902698 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:27.958102 tst ping.py: using LAC 35210 17:43:28.077691 tst ping.py: using RAC 20 17:43:28.198414 tst ping.py: using CellId 35210 17:43:28.320023 tst ping.py: using BVCI 35211 17:43:28.431260 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.442707 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.453722 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.464487 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.475247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.486126 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.497248 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:28.508167 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:28.625720 tst ping.py:19: start network... 17:43:28.846290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:29.346252 run create_hlr_db(pid=12542): Launched 17:43:29.470152 bus /gobi_6: Setting Powered False 17:43:30.533528 run create_hlr_db(pid=12542): Terminated: ok {rc=0} 17:43:30.992310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Launched 17:43:31.311791 run osmo-hlr_10.42.42.2(pid=12545): Launched 17:43:31.443092 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:32.137915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Launched 17:43:32.473341 run osmo-stp_10.42.42.5(pid=12548): Launched 17:43:32.600006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:33.162375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Launched 17:43:33.286407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:33.561669 run patchelf(pid=12551): Launched 17:43:33.742772 run osmo-stp_10.42.42.5(pid=12548): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] 17:43:33.880882 run osmo-stp_10.42.42.5(pid=12548): stdout: | (launched: 2022-12-13_17:43:32.413400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:34.021065 run osmo-stp_10.42.42.5(pid=12548): stderr: | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174332604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174332605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:34.161660 run osmo-stp_10.42.42.5(pid=12548): stdout: | (launched: 2022-12-13_17:43:32.413400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:34.295295 run osmo-stp_10.42.42.5(pid=12548): stderr: | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174332603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174332604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174332604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174332605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:34.454605 run patchelf(pid=12551): Terminating (SIGINT) 17:43:34.639290 run patchelf(pid=12551): Terminated: ok {rc=0} 17:43:34.771998 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12548): Process ended prematurely: osmo-stp_10.42.42.5(pid=12548) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 17:43:34.781642 tst ping.py:22: Test FAILED (6.9 sec) 17:43:34.810150 run osmo-hlr_10.42.42.2(pid=12545): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12545)] 17:43:34.862586 run osmo-hlr_10.42.42.2(pid=12545): stdout: | (launched: 2022-12-13_17:43:31.254645) 17:43:34.916186 run osmo-hlr_10.42.42.2(pid=12545): stderr: | [0;m[1;31m20221213174331632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174331632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174331632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174331633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174331633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174331633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174331654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174331676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174331676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174331676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:34.970035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Terminating (SIGTERM) 17:43:35.013025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Terminating (SIGTERM) 17:43:35.056460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Terminating (SIGTERM) 17:43:35.100194 --- ParallelTerminationStrategy: PID 12544 died... 17:43:35.121357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Terminated: ok {rc=0} 17:43:35.169351 --- ParallelTerminationStrategy: PID 12547 died... 17:43:35.189851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Terminated: ok {rc=0} 17:43:35.237731 --- ParallelTerminationStrategy: PID 12550 died... 17:43:35.258428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Terminated: ok {rc=0} 17:43:35.349891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:43:36.439226 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:36.451672 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:36.506684 tst ping_idle_ping.py: using LAC 35211 17:43:36.634437 tst ping_idle_ping.py: using RAC 21 17:43:36.761621 tst ping_idle_ping.py: using CellId 35211 17:43:36.881938 tst ping_idle_ping.py: using BVCI 35212 17:43:36.991463 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.003080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.014124 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.025152 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.036291 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.047391 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.058635 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:37.069526 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:37.186620 tst ping_idle_ping.py:24: start network... 17:43:37.390186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:37.863452 run create_hlr_db(pid=12552): Launched 17:43:37.988459 bus /gobi_6: Setting Powered False 17:43:39.048576 run create_hlr_db(pid=12552): Terminated: ok {rc=0} 17:43:39.495764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Launched 17:43:39.823228 run osmo-hlr_10.42.42.2(pid=12555): Launched 17:43:39.949121 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:40.513091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Launched 17:43:40.837871 run osmo-stp_10.42.42.5(pid=12558): Launched 17:43:40.962844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:41.525148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Launched 17:43:41.651269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:41.927628 run patchelf(pid=12561): Launched 17:43:42.111016 run osmo-stp_10.42.42.5(pid=12558): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] 17:43:42.249500 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-13_17:43:40.778129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:42.390138 run osmo-stp_10.42.42.5(pid=12558): stderr: | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174340968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:42.531478 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-13_17:43:40.778129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:42.665754 run osmo-stp_10.42.42.5(pid=12558): stderr: | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174340968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174340968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174340969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:42.824491 run patchelf(pid=12561): Terminating (SIGINT) 17:43:43.008877 run patchelf(pid=12561): Terminated: ok {rc=0} 17:43:43.141595 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 17:43:43.151164 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:43:43.179658 run osmo-hlr_10.42.42.2(pid=12555): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12555)] 17:43:43.231797 run osmo-hlr_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-13_17:43:39.763477) 17:43:43.285075 run osmo-hlr_10.42.42.2(pid=12555): stderr: | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174339960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174339973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174339984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174339984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174339984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:43.338407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminating (SIGTERM) 17:43:43.380898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminating (SIGTERM) 17:43:43.424171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Terminating (SIGTERM) 17:43:43.467525 --- ParallelTerminationStrategy: PID 12554 died... 17:43:43.488618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminated: ok {rc=0} 17:43:43.536193 --- ParallelTerminationStrategy: PID 12557 died... 17:43:43.556672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminated: ok {rc=0} 17:43:43.603958 --- ParallelTerminationStrategy: PID 12560 died... 17:43:43.624547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Terminated: ok {rc=0} 17:43:43.715064 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:43:45.033297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:43:45.040030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:43:45.075518 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:43:45.115832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:43:45.205122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:43:45.239654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:43:45.279270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:43:45.881417 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:43:45.943504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:45.956026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:46.032086 tst cs_paging_gprs_active.py: using LAC 35212 17:43:46.163003 tst cs_paging_gprs_active.py: using RAC 22 17:43:46.323664 tst cs_paging_gprs_active.py: using CellId 35212 17:43:46.475893 tst cs_paging_gprs_active.py: using BVCI 35213 17:43:46.601717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.614500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.627330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.640219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.653999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.667441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.681937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.695623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:46.709578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:46.859763 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:46.989493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:43:47.279461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:47.615310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12566): Launched 17:43:47.903422 run iperf3-srv_10.42.42.10(pid=12567): Launched 17:43:48.028618 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:43:48.251500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:48.585977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12568): Launched 17:43:48.874280 run iperf3-srv_10.42.42.10(pid=12569): Launched 17:43:48.999505 tst cs_paging_gprs_active.py:38: start network... 17:43:49.222592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:49.734484 run create_hlr_db(pid=12570): Launched 17:43:49.862148 bus /gobi_6: Setting Powered False 17:43:50.927312 run create_hlr_db(pid=12570): Terminated: ok {rc=0} 17:43:51.388245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12572): Launched 17:43:51.719741 run osmo-hlr_10.42.42.2(pid=12573): Launched 17:43:51.845380 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:52.421485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12575): Launched 17:43:52.753948 run osmo-stp_10.42.42.5(pid=12576): Launched 17:43:52.880760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:53.449648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12578): Launched 17:43:53.577787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:53.858645 run patchelf(pid=12579): Launched 17:43:54.043281 run osmo-stp_10.42.42.5(pid=12576): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12576)] 17:43:54.183880 run osmo-stp_10.42.42.5(pid=12576): stdout: | (launched: 2022-12-13_17:43:52.693704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:54.325489 run osmo-stp_10.42.42.5(pid=12576): stderr: | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174352885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:54.467733 run osmo-stp_10.42.42.5(pid=12576): stdout: | (launched: 2022-12-13_17:43:52.693704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:54.603736 run osmo-stp_10.42.42.5(pid=12576): stderr: | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174352884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174352885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174352885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:54.763949 run patchelf(pid=12579): Terminating (SIGINT) 17:43:54.951063 run patchelf(pid=12579): Terminated: ok {rc=0} 17:43:55.085820 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12576): Process ended prematurely: osmo-stp_10.42.42.5(pid=12576) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12576)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:43:55.096085 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 17:43:55.124904 run osmo-hlr_10.42.42.2(pid=12573): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12573)] 17:43:55.176695 run osmo-hlr_10.42.42.2(pid=12573): stdout: | (launched: 2022-12-13_17:43:51.659346) 17:43:55.230655 run osmo-hlr_10.42.42.2(pid=12573): stderr: | [0;m[1;31m20221213174351857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174351858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174351858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174351858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174351858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174351858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174351870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174351878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174351878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174351878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:55.284778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12566): Terminating (SIGTERM) 17:43:55.327221 run iperf3-srv_10.42.42.10(pid=12567): Terminating (SIGTERM) 17:43:55.370047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12568): Terminating (SIGTERM) 17:43:55.412878 run iperf3-srv_10.42.42.10(pid=12569): Terminating (SIGTERM) 17:43:55.455997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12572): Terminating (SIGTERM) 17:43:55.499217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12575): Terminating (SIGTERM) 17:43:55.542202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12578): Terminating (SIGTERM) 17:43:55.585476 --- ParallelTerminationStrategy: PID 12566 died... 17:43:55.606317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12566): Terminated: ok {rc=0} 17:43:55.653861 --- ParallelTerminationStrategy: PID 12567 died... 17:43:55.674253 run iperf3-srv_10.42.42.10(pid=12567): Terminated {rc=256} 17:43:55.721592 --- ParallelTerminationStrategy: PID 12568 died... 17:43:55.741980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12568): Terminated: ok {rc=0} 17:43:55.789226 --- ParallelTerminationStrategy: PID 12569 died... 17:43:55.809586 run iperf3-srv_10.42.42.10(pid=12569): Terminated {rc=256} 17:43:55.856716 --- ParallelTerminationStrategy: PID 12572 died... 17:43:55.877144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12572): Terminated: ok {rc=0} 17:43:55.924339 --- ParallelTerminationStrategy: PID 12575 died... 17:43:55.944941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12575): Terminated: ok {rc=0} 17:43:55.992134 --- ParallelTerminationStrategy: PID 12578 died... 17:43:56.012473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12578): Terminated: ok {rc=0} 17:43:56.101811 bus /gobi_0: Setting Powered False 17:43:57.202554 bus /gobi_0: Setting Powered False 17:43:58.321879 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:43:59.470377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:59.481966 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:59.554625 tst iperf3.py: using LAC 35213 17:43:59.674932 tst iperf3.py: using RAC 23 17:43:59.796587 tst iperf3.py: using CellId 35213 17:43:59.918719 tst iperf3.py: using BVCI 35214 17:44:00.031794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.042736 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.053585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.064833 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.075732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.086513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.097394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.108288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:00.119176 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:00.235348 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:00.441721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:00.750537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12580): Launched 17:44:01.033678 run iperf3-srv_10.42.42.10(pid=12581): Launched 17:44:01.207329 tst iperf3.py:8: start network... 17:44:01.422389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:01.907949 run create_hlr_db(pid=12582): Launched 17:44:02.065208 bus /gobi_6: Setting Powered False 17:44:03.126975 run create_hlr_db(pid=12582): Terminated: ok {rc=0} 17:44:03.556531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12584): Launched 17:44:03.864006 run osmo-hlr_10.42.42.2(pid=12585): Launched 17:44:03.981730 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:04.528742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12587): Launched 17:44:04.837671 run osmo-stp_10.42.42.5(pid=12588): Launched 17:44:04.955342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:05.490264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12590): Launched 17:44:05.609458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:05.870517 run patchelf(pid=12591): Launched 17:44:06.043065 run osmo-stp_10.42.42.5(pid=12588): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12588)] 17:44:06.174617 run osmo-stp_10.42.42.5(pid=12588): stdout: | (launched: 2022-12-13_17:44:04.780630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:06.307496 run osmo-stp_10.42.42.5(pid=12588): stderr: | [0;m[38;5;43m20221213174404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174404951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:06.440371 run osmo-stp_10.42.42.5(pid=12588): stdout: | (launched: 2022-12-13_17:44:04.780630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:06.566737 run osmo-stp_10.42.42.5(pid=12588): stderr: | [0;m[38;5;43m20221213174404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174404951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:06.717557 run patchelf(pid=12591): Terminating (SIGINT) 17:44:06.893532 run patchelf(pid=12591): Terminated: ok {rc=0} 17:44:07.020352 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12588): Process ended prematurely: osmo-stp_10.42.42.5(pid=12588) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12588)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 17:44:07.030120 tst iperf3.py:8: Test FAILED (7.6 sec) 17:44:07.057615 run osmo-hlr_10.42.42.2(pid=12585): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12585)] 17:44:07.106196 run osmo-hlr_10.42.42.2(pid=12585): stdout: | (launched: 2022-12-13_17:44:03.807313) 17:44:07.156478 run osmo-hlr_10.42.42.2(pid=12585): stderr: | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174403984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174403997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174404006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174404006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174404006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:07.207350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12580): Terminating (SIGTERM) 17:44:07.247969 run iperf3-srv_10.42.42.10(pid=12581): Terminating (SIGTERM) 17:44:07.288347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12584): Terminating (SIGTERM) 17:44:07.329017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12587): Terminating (SIGTERM) 17:44:07.369426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12590): Terminating (SIGTERM) 17:44:07.410132 --- ParallelTerminationStrategy: PID 12580 died... 17:44:07.429621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12580): Terminated: ok {rc=0} 17:44:07.474627 --- ParallelTerminationStrategy: PID 12581 died... 17:44:07.493448 run iperf3-srv_10.42.42.10(pid=12581): Terminated {rc=256} 17:44:07.537744 --- ParallelTerminationStrategy: PID 12584 died... 17:44:07.556502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12584): Terminated: ok {rc=0} 17:44:07.600605 --- ParallelTerminationStrategy: PID 12587 died... 17:44:07.619527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12587): Terminated: ok {rc=0} 17:44:07.664033 --- ParallelTerminationStrategy: PID 12590 died... 17:44:07.682940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12590): Terminated: ok {rc=0} 17:44:07.773089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:44:08.924197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:08.936657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:09.010470 tst iperf3m4.py: using LAC 35214 17:44:09.153448 tst iperf3m4.py: using RAC 24 17:44:09.287228 tst iperf3m4.py: using CellId 35214 17:44:09.417644 tst iperf3m4.py: using BVCI 35215 17:44:09.540092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.551601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.562922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.574266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.586140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.597949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.609903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.621629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:09.633846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:09.758059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:09.880739 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:10.003106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:10.121070 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:10.327435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:10.636639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12592): Launched 17:44:10.907072 run iperf3-srv_10.42.42.10(pid=12593): Launched 17:44:11.024453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:44:11.230607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:11.540344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12594): Launched 17:44:11.808939 run iperf3-srv_10.42.42.10(pid=12595): Launched 17:44:11.924829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:44:12.131627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:12.441767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12596): Launched 17:44:12.712165 run iperf3-srv_10.42.42.10(pid=12597): Launched 17:44:12.827753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:44:13.034336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:13.343327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Launched 17:44:13.613724 run iperf3-srv_10.42.42.10(pid=12599): Launched 17:44:13.728642 tst iperf3m4.py:8: start network... 17:44:13.934646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:14.411421 run create_hlr_db(pid=12600): Launched 17:44:14.538714 bus /gobi_6: Setting Powered False 17:44:15.600397 run create_hlr_db(pid=12600): Terminated: ok {rc=0} 17:44:16.035791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12602): Launched 17:44:16.361263 run osmo-hlr_10.42.42.2(pid=12603): Launched 17:44:16.591567 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:17.232461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12605): Launched 17:44:17.573603 run osmo-stp_10.42.42.5(pid=12606): Launched 17:44:17.702865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:18.275710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12608): Launched 17:44:18.404507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:18.685405 run patchelf(pid=12609): Launched 17:44:18.870248 run osmo-stp_10.42.42.5(pid=12606): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12606)] 17:44:19.010993 run osmo-stp_10.42.42.5(pid=12606): stdout: | (launched: 2022-12-13_17:44:17.513034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:19.152929 run osmo-stp_10.42.42.5(pid=12606): stderr: | [0;m[38;5;43m20221213174417700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174417700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174417701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174417701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:19.294733 run osmo-stp_10.42.42.5(pid=12606): stdout: | (launched: 2022-12-13_17:44:17.513034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:19.430219 run osmo-stp_10.42.42.5(pid=12606): stderr: | [0;m[38;5;43m20221213174417700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174417700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174417701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174417701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174417702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:19.591438 run patchelf(pid=12609): Terminating (SIGINT) 17:44:19.779138 run patchelf(pid=12609): Terminated: ok {rc=0} 17:44:19.914445 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12606): Process ended prematurely: osmo-stp_10.42.42.5(pid=12606) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12606)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:44:19.924710 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:44:19.954069 run osmo-hlr_10.42.42.2(pid=12603): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12603)] 17:44:20.006468 run osmo-hlr_10.42.42.2(pid=12603): stdout: | (launched: 2022-12-13_17:44:16.304077) 17:44:20.060357 run osmo-hlr_10.42.42.2(pid=12603): stderr: | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174416530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174416547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174416560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174416560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174416560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:20.114357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12592): Terminating (SIGTERM) 17:44:20.156903 run iperf3-srv_10.42.42.10(pid=12593): Terminating (SIGTERM) 17:44:20.200759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12594): Terminating (SIGTERM) 17:44:20.244000 run iperf3-srv_10.42.42.10(pid=12595): Terminating (SIGTERM) 17:44:20.287168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12596): Terminating (SIGTERM) 17:44:20.330592 run iperf3-srv_10.42.42.10(pid=12597): Terminating (SIGTERM) 17:44:20.373582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Terminating (SIGTERM) 17:44:20.416504 run iperf3-srv_10.42.42.10(pid=12599): Terminating (SIGTERM) 17:44:20.459642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12602): Terminating (SIGTERM) 17:44:20.502772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12605): Terminating (SIGTERM) 17:44:20.545512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12608): Terminating (SIGTERM) 17:44:20.588534 --- ParallelTerminationStrategy: PID 12592 died... 17:44:20.609308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12592): Terminated: ok {rc=0} 17:44:20.656590 --- ParallelTerminationStrategy: PID 12593 died... 17:44:20.676893 run iperf3-srv_10.42.42.10(pid=12593): Terminated {rc=256} 17:44:20.724257 --- ParallelTerminationStrategy: PID 12594 died... 17:44:20.744477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12594): Terminated: ok {rc=0} 17:44:20.792220 --- ParallelTerminationStrategy: PID 12595 died... 17:44:20.812468 run iperf3-srv_10.42.42.10(pid=12595): Terminated {rc=256} 17:44:20.859338 --- ParallelTerminationStrategy: PID 12596 died... 17:44:20.879613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12596): Terminated: ok {rc=0} 17:44:20.926851 --- ParallelTerminationStrategy: PID 12597 died... 17:44:20.947010 run iperf3-srv_10.42.42.10(pid=12597): Terminated {rc=256} 17:44:20.994053 --- ParallelTerminationStrategy: PID 12598 died... 17:44:21.014434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Terminated: ok {rc=0} 17:44:21.061779 --- ParallelTerminationStrategy: PID 12599 died... 17:44:21.082185 run iperf3-srv_10.42.42.10(pid=12599): Terminated {rc=256} 17:44:21.129261 --- ParallelTerminationStrategy: PID 12602 died... 17:44:21.149664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12602): Terminated: ok {rc=0} 17:44:21.197100 --- ParallelTerminationStrategy: PID 12605 died... 17:44:21.217530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12605): Terminated: ok {rc=0} 17:44:21.264733 --- ParallelTerminationStrategy: PID 12608 died... 17:44:21.285150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12608): Terminated: ok {rc=0} 17:44:21.375446 bus /gobi_4: Setting Powered False 17:44:22.475640 bus /gobi_4: Setting Powered False 17:44:23.593856 bus /gobi_1: Setting Powered False 17:44:24.693284 bus /gobi_1: Setting Powered False 17:44:25.814098 bus /gobi_0: Setting Powered False 17:44:26.914373 bus /gobi_0: Setting Powered False 17:44:28.036038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:44:29.140599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.152382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:29.222897 tst ping.py: using LAC 35215 17:44:29.343185 tst ping.py: using RAC 25 17:44:29.463011 tst ping.py: using CellId 35215 17:44:29.583222 tst ping.py: using BVCI 35216 17:44:29.694775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.706066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.717139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.727961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.738895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.749914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.760818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:29.771826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:29.888392 tst ping.py:19: start network... 17:44:30.091255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:30.558206 run create_hlr_db(pid=12610): Launched 17:44:30.683055 bus /gobi_6: Setting Powered False 17:44:31.757162 run create_hlr_db(pid=12610): Terminated: ok {rc=0} 17:44:32.273755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Launched 17:44:32.601907 run osmo-hlr_10.42.42.2(pid=12613): Launched 17:44:32.726867 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:33.291906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Launched 17:44:33.616885 run osmo-stp_10.42.42.5(pid=12616): Launched 17:44:33.739361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:34.301026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Launched 17:44:34.426543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:34.702183 run patchelf(pid=12619): Launched 17:44:34.882460 run osmo-stp_10.42.42.5(pid=12616): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] 17:44:35.020021 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-13_17:44:33.557002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:35.159751 run osmo-stp_10.42.42.5(pid=12616): stderr: | [0;m[38;5;43m20221213174433747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174433747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174433748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174433748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:35.299510 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-13_17:44:33.557002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:35.433096 run osmo-stp_10.42.42.5(pid=12616): stderr: | [0;m[38;5;43m20221213174433747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174433747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174433748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174433748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174433749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:35.591588 run patchelf(pid=12619): Terminating (SIGINT) 17:44:35.775655 run patchelf(pid=12619): Terminated: ok {rc=0} 17:44:35.907792 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 17:44:35.917398 tst ping.py:22: Test FAILED (6.8 sec) 17:44:35.945811 run osmo-hlr_10.42.42.2(pid=12613): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12613)] 17:44:35.997837 run osmo-hlr_10.42.42.2(pid=12613): stdout: | (launched: 2022-12-13_17:44:32.542226) 17:44:36.050921 run osmo-hlr_10.42.42.2(pid=12613): stderr: | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174432735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174432748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174432756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174432756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174432756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:36.104691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminating (SIGTERM) 17:44:36.147765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminating (SIGTERM) 17:44:36.191148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Terminating (SIGTERM) 17:44:36.234504 --- ParallelTerminationStrategy: PID 12612 died... 17:44:36.255540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminated: ok {rc=0} 17:44:36.303225 --- ParallelTerminationStrategy: PID 12615 died... 17:44:36.323770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminated: ok {rc=0} 17:44:36.371442 --- ParallelTerminationStrategy: PID 12618 died... 17:44:36.391831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Terminated: ok {rc=0} 17:44:36.483026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:44:37.571759 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:37.584101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:37.660454 tst ping_idle_ping.py: using LAC 35216 17:44:37.789643 tst ping_idle_ping.py: using RAC 26 17:44:37.910477 tst ping_idle_ping.py: using CellId 35216 17:44:38.028885 tst ping_idle_ping.py: using BVCI 35217 17:44:38.139106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.150398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.161450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.172310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.183121 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.194106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.204851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:38.215636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:38.337292 tst ping_idle_ping.py:24: start network... 17:44:38.558169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:39.069659 run create_hlr_db(pid=12620): Launched 17:44:39.194670 bus /gobi_6: Setting Powered False 17:44:40.259084 run create_hlr_db(pid=12620): Terminated: ok {rc=0} 17:44:40.694888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Launched 17:44:41.000633 run osmo-hlr_10.42.42.2(pid=12623): Launched 17:44:41.116143 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:41.644147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Launched 17:44:41.947913 run osmo-stp_10.42.42.5(pid=12626): Launched 17:44:42.063327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:42.587046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Launched 17:44:42.704815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:42.962365 run patchelf(pid=12629): Launched 17:44:43.132064 run osmo-stp_10.42.42.5(pid=12626): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] 17:44:43.259993 run osmo-stp_10.42.42.5(pid=12626): stdout: | (launched: 2022-12-13_17:44:41.891673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:43.390157 run osmo-stp_10.42.42.5(pid=12626): stderr: | [0;m[38;5;43m20221213174442059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174442059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174442060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174442060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:43.520297 run osmo-stp_10.42.42.5(pid=12626): stdout: | (launched: 2022-12-13_17:44:41.891673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:43.644373 run osmo-stp_10.42.42.5(pid=12626): stderr: | [0;m[38;5;43m20221213174442059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174442059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174442060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174442060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174442061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:43.790998 run patchelf(pid=12629): Terminating (SIGINT) 17:44:43.962469 run patchelf(pid=12629): Terminated: ok {rc=0} 17:44:44.085981 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12626): Process ended prematurely: osmo-stp_10.42.42.5(pid=12626) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:44:44.094921 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:44:44.121626 run osmo-hlr_10.42.42.2(pid=12623): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12623)] 17:44:44.169923 run osmo-hlr_10.42.42.2(pid=12623): stdout: | (launched: 2022-12-13_17:44:40.944580) 17:44:44.219764 run osmo-hlr_10.42.42.2(pid=12623): stderr: | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174441118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174441131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174441140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174441140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174441140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:44.270086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Terminating (SIGTERM) 17:44:44.310269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Terminating (SIGTERM) 17:44:44.350643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Terminating (SIGTERM) 17:44:44.390774 --- ParallelTerminationStrategy: PID 12622 died... 17:44:44.410221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Terminated: ok {rc=0} 17:44:44.454996 --- ParallelTerminationStrategy: PID 12625 died... 17:44:44.473931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Terminated: ok {rc=0} 17:44:44.518220 --- ParallelTerminationStrategy: PID 12628 died... 17:44:44.537029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Terminated: ok {rc=0} 17:44:44.623962 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:44:45.952123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:45.963310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:44:46.004029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:44:46.051921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:44:46.138657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:44:46.172750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:44:46.211934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:44:46.813262 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:44:46.869280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:46.883858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:46.960283 tst cs_paging_gprs_active.py: using LAC 35217 17:44:47.120477 tst cs_paging_gprs_active.py: using RAC 27 17:44:47.243772 tst cs_paging_gprs_active.py: using CellId 35217 17:44:47.368462 tst cs_paging_gprs_active.py: using BVCI 35218 17:44:47.482061 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.492941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.503786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.514543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.525494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.536157 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.547051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.557810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:47.568617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:47.691527 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:47.810518 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:44:48.017278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:48.327215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12634): Launched 17:44:48.597187 run iperf3-srv_10.42.42.10(pid=12635): Launched 17:44:48.712523 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:44:48.918863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:49.230176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12636): Launched 17:44:49.500750 run iperf3-srv_10.42.42.10(pid=12637): Launched 17:44:49.616428 tst cs_paging_gprs_active.py:38: start network... 17:44:49.823422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:50.301596 run create_hlr_db(pid=12638): Launched 17:44:50.427022 bus /gobi_6: Setting Powered False 17:44:51.488392 run create_hlr_db(pid=12638): Terminated: ok {rc=0} 17:44:51.939923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Launched 17:44:52.271245 run osmo-hlr_10.42.42.2(pid=12641): Launched 17:44:52.397036 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:52.964428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Launched 17:44:53.296602 run osmo-stp_10.42.42.5(pid=12644): Launched 17:44:53.421820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:53.991339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Launched 17:44:54.118226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:54.397672 run patchelf(pid=12647): Launched 17:44:54.582349 run osmo-stp_10.42.42.5(pid=12644): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] 17:44:54.722655 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-13_17:44:53.236176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:54.864511 run osmo-stp_10.42.42.5(pid=12644): stderr: | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174453427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:55.006109 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-13_17:44:53.236176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:55.141431 run osmo-stp_10.42.42.5(pid=12644): stderr: | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174453427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174453427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174453428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:55.301663 run patchelf(pid=12647): Terminating (SIGINT) 17:44:55.489204 run patchelf(pid=12647): Terminated: ok {rc=0} 17:44:55.624240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:44:55.634548 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:44:55.663367 run osmo-hlr_10.42.42.2(pid=12641): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12641)] 17:44:55.714849 run osmo-hlr_10.42.42.2(pid=12641): stdout: | (launched: 2022-12-13_17:44:52.210991) 17:44:55.767738 run osmo-hlr_10.42.42.2(pid=12641): stderr: | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174452406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174452419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174452428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174452428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174452428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:55.821130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12634): Terminating (SIGTERM) 17:44:55.863515 run iperf3-srv_10.42.42.10(pid=12635): Terminating (SIGTERM) 17:44:55.906286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12636): Terminating (SIGTERM) 17:44:55.949491 run iperf3-srv_10.42.42.10(pid=12637): Terminating (SIGTERM) 17:44:55.992168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminating (SIGTERM) 17:44:56.035281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminating (SIGTERM) 17:44:56.078046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Terminating (SIGTERM) 17:44:56.120760 --- ParallelTerminationStrategy: PID 12634 died... 17:44:56.141487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12634): Terminated: ok {rc=0} 17:44:56.188657 --- ParallelTerminationStrategy: PID 12635 died... 17:44:56.208783 run iperf3-srv_10.42.42.10(pid=12635): Terminated {rc=256} 17:44:56.255827 --- ParallelTerminationStrategy: PID 12636 died... 17:44:56.275916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12636): Terminated: ok {rc=0} 17:44:56.322663 --- ParallelTerminationStrategy: PID 12637 died... 17:44:56.342742 run iperf3-srv_10.42.42.10(pid=12637): Terminated {rc=256} 17:44:56.389471 --- ParallelTerminationStrategy: PID 12640 died... 17:44:56.409467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminated: ok {rc=0} 17:44:56.456764 --- ParallelTerminationStrategy: PID 12643 died... 17:44:56.477222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminated: ok {rc=0} 17:44:56.524151 --- ParallelTerminationStrategy: PID 12646 died... 17:44:56.544351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Terminated: ok {rc=0} 17:44:56.634164 bus /gobi_0: Setting Powered False 17:44:57.733910 bus /gobi_0: Setting Powered False 17:44:58.850822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:45:00.002081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.014348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:00.090763 tst iperf3.py: using LAC 35218 17:45:00.221258 tst iperf3.py: using RAC 28 17:45:00.351111 tst iperf3.py: using CellId 35218 17:45:00.477518 tst iperf3.py: using BVCI 35219 17:45:00.591587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.602814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.613902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.624578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.635597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.646394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.657465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.668135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:00.679020 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:00.800800 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:45:01.040878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:45:01.363610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12648): Launched 17:45:01.680778 run iperf3-srv_10.42.42.10(pid=12652): Launched 17:45:01.815699 tst iperf3.py:8: start network... 17:45:02.030902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:02.514804 run create_hlr_db(pid=12653): Launched 17:45:02.641260 bus /gobi_6: Setting Powered False 17:45:03.702354 run create_hlr_db(pid=12653): Terminated: ok {rc=0} 17:45:04.131880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12655): Launched 17:45:04.440207 run osmo-hlr_10.42.42.2(pid=12656): Launched 17:45:04.557271 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:05.088820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12658): Launched 17:45:05.397186 run osmo-stp_10.42.42.5(pid=12659): Launched 17:45:05.513075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:06.042476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12661): Launched 17:45:06.160591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:06.421709 run patchelf(pid=12662): Launched 17:45:06.593503 run osmo-stp_10.42.42.5(pid=12659): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12659)] 17:45:06.723985 run osmo-stp_10.42.42.5(pid=12659): stdout: | (launched: 2022-12-13_17:45:05.340277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:06.856012 run osmo-stp_10.42.42.5(pid=12659): stderr: | [0;m[38;5;43m20221213174505511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174505511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174505512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174505512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:06.988129 run osmo-stp_10.42.42.5(pid=12659): stdout: | (launched: 2022-12-13_17:45:05.340277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:07.114431 run osmo-stp_10.42.42.5(pid=12659): stderr: | [0;m[38;5;43m20221213174505511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174505511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174505512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174505512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174505513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:07.263947 run patchelf(pid=12662): Terminating (SIGINT) 17:45:07.439062 run patchelf(pid=12662): Terminated: ok {rc=0} 17:45:07.565195 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12659): Process ended prematurely: osmo-stp_10.42.42.5(pid=12659) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12659)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 17:45:07.574752 tst iperf3.py:8: Test FAILED (7.6 sec) 17:45:07.601754 run osmo-hlr_10.42.42.2(pid=12656): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12656)] 17:45:07.649616 run osmo-hlr_10.42.42.2(pid=12656): stdout: | (launched: 2022-12-13_17:45:04.383387) 17:45:07.699535 run osmo-hlr_10.42.42.2(pid=12656): stderr: | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174504557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174504569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174504577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174504578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174504578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:07.749674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12648): Terminating (SIGTERM) 17:45:07.789789 run iperf3-srv_10.42.42.10(pid=12652): Terminating (SIGTERM) 17:45:07.829791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12655): Terminating (SIGTERM) 17:45:07.870001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12658): Terminating (SIGTERM) 17:45:07.910002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12661): Terminating (SIGTERM) 17:45:07.950301 --- ParallelTerminationStrategy: PID 12648 died... 17:45:07.969765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12648): Terminated: ok {rc=0} 17:45:08.014177 --- ParallelTerminationStrategy: PID 12652 died... 17:45:08.032834 run iperf3-srv_10.42.42.10(pid=12652): Terminated {rc=256} 17:45:08.077173 --- ParallelTerminationStrategy: PID 12655 died... 17:45:08.096044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12655): Terminated: ok {rc=0} 17:45:08.140294 --- ParallelTerminationStrategy: PID 12658 died... 17:45:08.159203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12658): Terminated: ok {rc=0} 17:45:08.203217 --- ParallelTerminationStrategy: PID 12661 died... 17:45:08.222197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12661): Terminated: ok {rc=0} 17:45:08.308818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:45:09.457476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:09.469345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:09.541487 tst iperf3m4.py: using LAC 35219 17:45:09.662184 tst iperf3m4.py: using RAC 29 17:45:09.783770 tst iperf3m4.py: using CellId 35219 17:45:09.905011 tst iperf3m4.py: using BVCI 35220 17:45:10.018031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.029196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.039923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.050829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.062154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.073082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.084206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.095231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:10.106443 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:10.229942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:10.351347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:10.473790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:10.593358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:45:10.818090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:45:11.151302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12663): Launched 17:45:11.441966 run iperf3-srv_10.42.42.10(pid=12664): Launched 17:45:11.567714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:45:11.791120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:45:12.122708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12665): Launched 17:45:12.411408 run iperf3-srv_10.42.42.10(pid=12666): Launched 17:45:12.537089 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:45:12.760373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:45:13.092473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12667): Launched 17:45:13.382357 run iperf3-srv_10.42.42.10(pid=12668): Launched 17:45:13.506847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:45:13.729566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:45:14.061519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12669): Launched 17:45:14.350948 run iperf3-srv_10.42.42.10(pid=12670): Launched 17:45:14.476308 tst iperf3m4.py:8: start network... 17:45:14.699110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:15.210299 run create_hlr_db(pid=12671): Launched 17:45:15.338142 bus /gobi_6: Setting Powered False 17:45:16.403774 run create_hlr_db(pid=12671): Terminated: ok {rc=0} 17:45:16.874132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12673): Launched 17:45:17.221971 run osmo-hlr_10.42.42.2(pid=12674): Launched 17:45:17.350273 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:17.925361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12676): Launched 17:45:18.256118 run osmo-stp_10.42.42.5(pid=12677): Launched 17:45:18.381703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:18.951421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12679): Launched 17:45:19.084595 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:19.364534 run patchelf(pid=12680): Launched 17:45:19.550541 run osmo-stp_10.42.42.5(pid=12677): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12677)] 17:45:19.690838 run osmo-stp_10.42.42.5(pid=12677): stdout: | (launched: 2022-12-13_17:45:18.195250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:19.832636 run osmo-stp_10.42.42.5(pid=12677): stderr: | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174518387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:19.974324 run osmo-stp_10.42.42.5(pid=12677): stdout: | (launched: 2022-12-13_17:45:18.195250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:20.109908 run osmo-stp_10.42.42.5(pid=12677): stderr: | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174518386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174518387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174518387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:20.270097 run patchelf(pid=12680): Terminating (SIGINT) 17:45:20.457482 run patchelf(pid=12680): Terminated: ok {rc=0} 17:45:20.592547 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12677): Process ended prematurely: osmo-stp_10.42.42.5(pid=12677) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12677)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:45:20.603000 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:45:20.631926 run osmo-hlr_10.42.42.2(pid=12674): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12674)] 17:45:20.683359 run osmo-hlr_10.42.42.2(pid=12674): stdout: | (launched: 2022-12-13_17:45:17.160772) 17:45:20.736253 run osmo-hlr_10.42.42.2(pid=12674): stderr: | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174517357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174517369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174517378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174517378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174517378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:20.789924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12663): Terminating (SIGTERM) 17:45:20.832494 run iperf3-srv_10.42.42.10(pid=12664): Terminating (SIGTERM) 17:45:20.875711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12665): Terminating (SIGTERM) 17:45:20.918548 run iperf3-srv_10.42.42.10(pid=12666): Terminating (SIGTERM) 17:45:20.961815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12667): Terminating (SIGTERM) 17:45:21.004574 run iperf3-srv_10.42.42.10(pid=12668): Terminating (SIGTERM) 17:45:21.048492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12669): Terminating (SIGTERM) 17:45:21.089427 run iperf3-srv_10.42.42.10(pid=12670): Terminating (SIGTERM) 17:45:21.129305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12673): Terminating (SIGTERM) 17:45:21.169325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12676): Terminating (SIGTERM) 17:45:21.209251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12679): Terminating (SIGTERM) 17:45:21.250808 --- ParallelTerminationStrategy: PID 12663 died... 17:45:21.270110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12663): Terminated: ok {rc=0} 17:45:21.314609 --- ParallelTerminationStrategy: PID 12664 died... 17:45:21.333493 run iperf3-srv_10.42.42.10(pid=12664): Terminated {rc=256} 17:45:21.377761 --- ParallelTerminationStrategy: PID 12665 died... 17:45:21.396447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12665): Terminated: ok {rc=0} 17:45:21.440729 --- ParallelTerminationStrategy: PID 12666 died... 17:45:21.459674 run iperf3-srv_10.42.42.10(pid=12666): Terminated {rc=256} 17:45:21.503865 --- ParallelTerminationStrategy: PID 12667 died... 17:45:21.522750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12667): Terminated: ok {rc=0} 17:45:21.567237 --- ParallelTerminationStrategy: PID 12668 died... 17:45:21.586233 run iperf3-srv_10.42.42.10(pid=12668): Terminated {rc=256} 17:45:21.630572 --- ParallelTerminationStrategy: PID 12669 died... 17:45:21.649470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12669): Terminated: ok {rc=0} 17:45:21.693806 --- ParallelTerminationStrategy: PID 12670 died... 17:45:21.712526 run iperf3-srv_10.42.42.10(pid=12670): Terminated {rc=256} 17:45:21.756749 --- ParallelTerminationStrategy: PID 12673 died... 17:45:21.775688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12673): Terminated: ok {rc=0} 17:45:21.820289 --- ParallelTerminationStrategy: PID 12676 died... 17:45:21.839140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12676): Terminated: ok {rc=0} 17:45:21.883687 --- ParallelTerminationStrategy: PID 12679 died... 17:45:21.902582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12679): Terminated: ok {rc=0} 17:45:21.987277 bus /gobi_4: Setting Powered False 17:45:23.087707 bus /gobi_4: Setting Powered False 17:45:24.206707 bus /gobi_1: Setting Powered False 17:45:25.304707 bus /gobi_1: Setting Powered False 17:45:26.420292 bus /gobi_0: Setting Powered False 17:45:27.520504 bus /gobi_0: Setting Powered False 17:45:28.640854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:45:29.745463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:29.756931 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:29.829828 tst ping.py: using LAC 35220 17:45:29.948896 tst ping.py: using RAC 30 17:45:30.065543 tst ping.py: using CellId 35220 17:45:30.187485 tst ping.py: using BVCI 35221 17:45:30.296080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.307115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.317960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.328700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.339493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.350748 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.361624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:30.372557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:30.493991 tst ping.py:19: start network... 17:45:30.714138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:31.220101 run create_hlr_db(pid=12682): Launched 17:45:31.380923 bus /gobi_6: Setting Powered False 17:45:32.441505 run create_hlr_db(pid=12682): Terminated: ok {rc=0} 17:45:32.897307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Launched 17:45:33.222586 run osmo-hlr_10.42.42.2(pid=12685): Launched 17:45:33.347895 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:33.918485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Launched 17:45:34.242834 run osmo-stp_10.42.42.5(pid=12688): Launched 17:45:34.366143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:34.925231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Launched 17:45:35.050115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:35.323687 run patchelf(pid=12691): Launched 17:45:35.505356 run osmo-stp_10.42.42.5(pid=12688): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] 17:45:35.643254 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-13_17:45:34.182887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:35.782745 run osmo-stp_10.42.42.5(pid=12688): stderr: | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174534373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:35.922034 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-13_17:45:34.182887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:36.054813 run osmo-stp_10.42.42.5(pid=12688): stderr: | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174534372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174534373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174534373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:36.212198 run patchelf(pid=12691): Terminating (SIGINT) 17:45:36.395584 run patchelf(pid=12691): Terminated: ok {rc=0} 17:45:36.528194 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 17:45:36.538035 tst ping.py:22: Test FAILED (6.8 sec) 17:45:36.566102 run osmo-hlr_10.42.42.2(pid=12685): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12685)] 17:45:36.617630 run osmo-hlr_10.42.42.2(pid=12685): stdout: | (launched: 2022-12-13_17:45:33.163219) 17:45:36.670286 run osmo-hlr_10.42.42.2(pid=12685): stderr: | [0;m[1;31m20221213174533357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174533358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174533358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174533358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174533358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174533358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174533369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174533377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174533378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174533378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:36.723306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminating (SIGTERM) 17:45:36.765723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminating (SIGTERM) 17:45:36.808671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Terminating (SIGTERM) 17:45:36.851528 --- ParallelTerminationStrategy: PID 12684 died... 17:45:36.872269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminated: ok {rc=0} 17:45:36.919383 --- ParallelTerminationStrategy: PID 12687 died... 17:45:36.939482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminated: ok {rc=0} 17:45:36.986618 --- ParallelTerminationStrategy: PID 12690 died... 17:45:37.006817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Terminated: ok {rc=0} 17:45:37.097494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:45:38.185518 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.197622 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:38.272783 tst ping_idle_ping.py: using LAC 35221 17:45:38.402271 tst ping_idle_ping.py: using RAC 31 17:45:38.535363 tst ping_idle_ping.py: using CellId 35221 17:45:38.662293 tst ping_idle_ping.py: using BVCI 35222 17:45:38.780861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.792468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.803932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.815283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.827263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.839407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.851682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:38.863862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:38.983629 tst ping_idle_ping.py:24: start network... 17:45:39.186916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:39.658770 run create_hlr_db(pid=12692): Launched 17:45:39.784807 bus /gobi_6: Setting Powered False 17:45:40.845948 run create_hlr_db(pid=12692): Terminated: ok {rc=0} 17:45:41.270406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Launched 17:45:41.576797 run osmo-hlr_10.42.42.2(pid=12695): Launched 17:45:41.691342 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:42.217592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Launched 17:45:42.521847 run osmo-stp_10.42.42.5(pid=12698): Launched 17:45:42.637150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:43.159808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Launched 17:45:43.276361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:43.534699 run patchelf(pid=12701): Launched 17:45:43.705834 run osmo-stp_10.42.42.5(pid=12698): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] 17:45:43.834868 run osmo-stp_10.42.42.5(pid=12698): stdout: | (launched: 2022-12-13_17:45:42.465408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:43.965706 run osmo-stp_10.42.42.5(pid=12698): stderr: | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174542636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:44.096744 run osmo-stp_10.42.42.5(pid=12698): stdout: | (launched: 2022-12-13_17:45:42.465408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:44.221190 run osmo-stp_10.42.42.5(pid=12698): stderr: | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174542635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174542636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174542636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:44.369182 run patchelf(pid=12701): Terminating (SIGINT) 17:45:44.542635 run patchelf(pid=12701): Terminated: ok {rc=0} 17:45:44.667495 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12698): Process ended prematurely: osmo-stp_10.42.42.5(pid=12698) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:45:44.676684 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:45:44.703582 run osmo-hlr_10.42.42.2(pid=12695): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12695)] 17:45:44.751901 run osmo-hlr_10.42.42.2(pid=12695): stdout: | (launched: 2022-12-13_17:45:41.520343) 17:45:44.802013 run osmo-hlr_10.42.42.2(pid=12695): stderr: | [0;m[1;31m20221213174541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174541695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174541695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174541695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174541705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174541714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174541715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174541715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:44.852458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Terminating (SIGTERM) 17:45:44.892686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Terminating (SIGTERM) 17:45:44.932638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Terminating (SIGTERM) 17:45:44.972894 --- ParallelTerminationStrategy: PID 12694 died... 17:45:44.991718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Terminated: ok {rc=0} 17:45:45.036897 --- ParallelTerminationStrategy: PID 12697 died... 17:45:45.055698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Terminated: ok {rc=0} 17:45:45.099946 --- ParallelTerminationStrategy: PID 12700 died... 17:45:45.118834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Terminated: ok {rc=0} 17:45:45.206242 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:45:46.557866 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:46.572083 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:45:46.621484 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:45:46.663801 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:45:46.727814 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:45:46.782985 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:45:46.819216 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:45:47.354343 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:45:47.359739 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.371027 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:45:47.441731 tst switch_tch_pdch.py: using LAC 35222 17:45:47.565832 tst switch_tch_pdch.py: using RAC 32 17:45:47.683541 tst switch_tch_pdch.py: using CellId 35222 17:45:47.800175 tst switch_tch_pdch.py: using BVCI 35223 17:45:47.909737 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.920890 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.931982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.943134 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.954301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.965303 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.976794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:47.987990 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:48.111093 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:48.230875 tst switch_tch_pdch.py:51: start network... 17:45:48.434000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:48.904161 run create_hlr_db(pid=12705): Launched 17:45:49.032239 bus /gobi_6: Setting Powered False 17:45:50.097289 run create_hlr_db(pid=12705): Terminated: ok {rc=0} 17:45:50.552366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12707): Launched 17:45:50.878700 run osmo-hlr_10.42.42.2(pid=12708): Launched 17:45:51.004597 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:51.567219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12710): Launched 17:45:51.891444 run osmo-stp_10.42.42.5(pid=12713): Launched 17:45:52.025686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:52.586677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Launched 17:45:52.711754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:52.986289 run patchelf(pid=12718): Launched 17:45:53.167505 run osmo-stp_10.42.42.5(pid=12713): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12713)] 17:45:53.304889 run osmo-stp_10.42.42.5(pid=12713): stdout: | (launched: 2022-12-13_17:45:51.831310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:53.444236 run osmo-stp_10.42.42.5(pid=12713): stderr: | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174552054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:53.584168 run osmo-stp_10.42.42.5(pid=12713): stdout: | (launched: 2022-12-13_17:45:51.831310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:53.717311 run osmo-stp_10.42.42.5(pid=12713): stderr: | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174552054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174552054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174552055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:53.874972 run patchelf(pid=12718): Terminating (SIGINT) 17:45:54.058497 run patchelf(pid=12718): Terminated: ok {rc=0} 17:45:54.190517 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12713): Process ended prematurely: osmo-stp_10.42.42.5(pid=12713) [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12713)] [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:45:54.200038 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:45:54.228289 run osmo-hlr_10.42.42.2(pid=12708): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12708)] 17:45:54.279495 run osmo-hlr_10.42.42.2(pid=12708): stdout: | (launched: 2022-12-13_17:45:50.818584) 17:45:54.332801 run osmo-hlr_10.42.42.2(pid=12708): stderr: | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174551015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174551027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174551035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174551035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174551035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:54.386072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12707): Terminating (SIGTERM) 17:45:54.428460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12710): Terminating (SIGTERM) 17:45:54.471559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Terminating (SIGTERM) 17:45:54.514506 --- ParallelTerminationStrategy: PID 12707 died... 17:45:54.535216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12707): Terminated: ok {rc=0} 17:45:54.582440 --- ParallelTerminationStrategy: PID 12710 died... 17:45:54.602604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12710): Terminated: ok {rc=0} 17:45:54.649781 --- ParallelTerminationStrategy: PID 12717 died... 17:45:54.670027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Terminated: ok {rc=0} 17:45:54.759883 bus /gobi_0: Setting Powered False 17:45:55.860164 bus /gobi_0: Setting Powered False 17:45:56.981897 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:45:58.235698 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:58.243292 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:45:58.279142 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:45:58.314921 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:45:58.369983 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:45:58.404856 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:45:58.440410 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:45:58.993422 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:45:58.998707 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.010058 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:45:59.079926 tst switch_tch_pdch.py: using LAC 35223 17:45:59.198263 tst switch_tch_pdch.py: using RAC 33 17:45:59.320575 tst switch_tch_pdch.py: using CellId 35223 17:45:59.440818 tst switch_tch_pdch.py: using BVCI 35224 17:45:59.560700 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.572383 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.583774 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.595249 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.606943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.618689 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.630511 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:59.642161 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:59.759301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:59.880515 tst switch_tch_pdch.py:51: start network... 17:46:00.099896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:00.574320 run create_hlr_db(pid=12722): Launched 17:46:00.698817 bus /gobi_6: Setting Powered False 17:46:01.762830 run create_hlr_db(pid=12722): Terminated: ok {rc=0} 17:46:02.197072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12724): Launched 17:46:02.502176 run osmo-hlr_10.42.42.2(pid=12725): Launched 17:46:02.618500 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:03.125660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12727): Launched 17:46:03.428012 run osmo-stp_10.42.42.5(pid=12728): Launched 17:46:03.542715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:46:04.039035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12730): Launched 17:46:04.155755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:46:04.411266 run patchelf(pid=12731): Launched 17:46:04.581172 run osmo-stp_10.42.42.5(pid=12728): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12728)] 17:46:04.709069 run osmo-stp_10.42.42.5(pid=12728): stdout: | (launched: 2022-12-13_17:46:03.371985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:04.838895 run osmo-stp_10.42.42.5(pid=12728): stderr: | [0;m[38;5;43m20221213174603539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174603540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174603540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174603540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:04.968659 run osmo-stp_10.42.42.5(pid=12728): stdout: | (launched: 2022-12-13_17:46:03.371985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:05.091919 run osmo-stp_10.42.42.5(pid=12728): stderr: | [0;m[38;5;43m20221213174603539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174603540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174603540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174603540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174603541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:05.238334 run patchelf(pid=12731): Terminating (SIGINT) 17:46:05.409779 run patchelf(pid=12731): Terminated: ok {rc=0} 17:46:05.533504 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12728): Process ended prematurely: osmo-stp_10.42.42.5(pid=12728) [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12728)] [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:46:05.542369 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:46:05.569114 run osmo-hlr_10.42.42.2(pid=12725): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12725)] 17:46:05.617737 run osmo-hlr_10.42.42.2(pid=12725): stdout: | (launched: 2022-12-13_17:46:02.446268) 17:46:05.667486 run osmo-hlr_10.42.42.2(pid=12725): stderr: | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174602620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174602633 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174602643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174602643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174602643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:05.717580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12724): Terminating (SIGTERM) 17:46:05.757774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12727): Terminating (SIGTERM) 17:46:05.797821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12730): Terminating (SIGTERM) 17:46:05.838094 --- ParallelTerminationStrategy: PID 12724 died... 17:46:05.857280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12724): Terminated: ok {rc=0} 17:46:05.901618 --- ParallelTerminationStrategy: PID 12727 died... 17:46:05.920316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12727): Terminated: ok {rc=0} 17:46:05.964809 --- ParallelTerminationStrategy: PID 12730 died... 17:46:05.983999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12730): Terminated: ok {rc=0} 17:46:06.070984 bus /gobi_0: Setting Powered False 17:46:07.170924 bus /gobi_0: Setting Powered False 17:46:08.286813 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:trx-umtrx --------------------------------------------------------------------- 17:46:09.548838 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:09.553529 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:09.586843 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:46:09.594452 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:46:09.646797 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:09.680243 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:46:09.687373 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:46:10.226894 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:46:10.232264 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:46:10.243438 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:10.293348 tst mo_mt_sms.py: using LAC 35224 17:46:10.420925 tst mo_mt_sms.py: using RAC 34 17:46:10.540405 tst mo_mt_sms.py: using CellId 35224 17:46:10.659767 tst mo_mt_sms.py: using BVCI 35225 17:46:10.770444 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:10.890407 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:11.005591 tst mo_mt_sms.py:9: start nitb and bts... 17:46:11.211213 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:46:11.832240 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12735): Launched 17:46:12.136835 run osmo-nitb_10.42.42.2(pid=12736): Launched 17:46:12.304765 run osmo-nitb_10.42.42.2(pid=12736): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12736)] 17:46:12.440850 run osmo-nitb_10.42.42.2(pid=12736): stdout: | (launched: 2022-12-13_17:46:12.080716) 17:46:12.578664 run osmo-nitb_10.42.42.2(pid=12736): stderr: | (launched: 2022-12-13_17:46:12.125909) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:12.716212 run osmo-nitb_10.42.42.2(pid=12736): stdout: | (launched: 2022-12-13_17:46:12.080716) 17:46:12.847969 run osmo-nitb_10.42.42.2(pid=12736): stderr: | (launched: 2022-12-13_17:46:12.125909) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12736) [trial-2392↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12736)] 17:46:13.251005 tst osmo-nitb_10.42.42.2(pid=12736): stdout: | (launched: 2022-12-13_17:46:12.080716) 17:46:13.374255 tst osmo-nitb_10.42.42.2(pid=12736): stderr: | (launched: 2022-12-13_17:46:12.125909) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:13.519023 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12736) [trial-2392↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12736)] [trial-2392↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 17:46:13.527374 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 17:46:13.533949 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12735): Terminating (SIGTERM) 17:46:13.743053 --- ParallelTerminationStrategy: PID 12735 died... 17:46:13.764096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12735): Terminated: ok {rc=0} 17:46:13.852805 bus /sierra_3: Setting Powered False 17:46:14.954901 bus /sierra_3: Setting Powered False 17:46:16.075842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:trx-umtrx --------------------------------------------------------------------- 17:46:17.281550 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:17.286758 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:17.320269 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:46:17.348869 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:46:17.401923 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:17.435526 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:46:17.463294 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:46:18.009388 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:46:18.014826 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.026034 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:18.075497 tst mo_mt_sms.py: using LAC 35225 17:46:18.194714 tst mo_mt_sms.py: using RAC 35 17:46:18.316322 tst mo_mt_sms.py: using CellId 35225 17:46:18.449377 tst mo_mt_sms.py: using BVCI 35226 17:46:18.560687 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.571239 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.581637 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.591884 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.602227 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:18.612557 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:18.730203 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:18.846746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:19.313748 run create_hlr_db(pid=12740): Launched 17:46:19.437584 bus /sierra_2: Setting Powered False 17:46:20.497885 run create_hlr_db(pid=12740): Terminated: ok {rc=0} 17:46:20.920728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12742): Launched 17:46:21.223084 run osmo-hlr_10.42.42.2(pid=12743): Launched 17:46:21.336772 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:21.857361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12745): Launched 17:46:22.208621 run osmo-stp_10.42.42.5(pid=12746): Launched 17:46:22.332794 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:22.921504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12748): Launched 17:46:23.248306 run osmo-msc_10.42.42.6(pid=12749): Launched 17:46:23.428909 run osmo-stp_10.42.42.5(pid=12746): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12746)] 17:46:23.566379 run osmo-stp_10.42.42.5(pid=12746): stdout: | (launched: 2022-12-13_17:46:22.149162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:23.704024 run osmo-stp_10.42.42.5(pid=12746): stderr: | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174622339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:23.839860 run osmo-stp_10.42.42.5(pid=12746): stdout: | (launched: 2022-12-13_17:46:22.149162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:23.969561 run osmo-stp_10.42.42.5(pid=12746): stderr: | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174622338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174622339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174622339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:24.123901 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12746): Process ended prematurely: osmo-stp_10.42.42.5(pid=12746) [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12746)] [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py:16] 17:46:24.133397 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 17:46:24.161176 run osmo-hlr_10.42.42.2(pid=12743): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12743)] 17:46:24.213094 run osmo-hlr_10.42.42.2(pid=12743): stdout: | (launched: 2022-12-13_17:46:21.167338) 17:46:24.266182 run osmo-hlr_10.42.42.2(pid=12743): stderr: | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174621339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174621352 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174621361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174621361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174621361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:24.339787 run osmo-msc_10.42.42.6(pid=12749): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12749)] 17:46:24.390710 run osmo-msc_10.42.42.6(pid=12749): stdout: | (launched: 2022-12-13_17:46:23.188757) 17:46:24.443830 run osmo-msc_10.42.42.6(pid=12749): stderr: | [0;m[38;5;43m20221213174623508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174623508 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9cb83dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174623508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174623508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174623509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174623509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174623510 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174623511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174623511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174623511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:24.497140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12742): Terminating (SIGTERM) 17:46:24.540113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12745): Terminating (SIGTERM) 17:46:24.583562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12748): Terminating (SIGTERM) 17:46:24.627150 --- ParallelTerminationStrategy: PID 12742 died... 17:46:24.647979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12742): Terminated: ok {rc=0} 17:46:24.695181 --- ParallelTerminationStrategy: PID 12745 died... 17:46:24.715285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12745): Terminated: ok {rc=0} 17:46:24.762273 --- ParallelTerminationStrategy: PID 12748 died... 17:46:24.782400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12748): Terminated: ok {rc=0} 17:46:24.871906 bus /sierra_3: Setting Powered False 17:46:25.972144 bus /sierra_3: Setting Powered False 17:46:27.089629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 17:46:28.324347 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:28.328467 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:28.361625 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:46:28.369072 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:28.406079 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:28.440177 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:46:28.447622 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:28.966523 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:28.971757 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:46:28.983093 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:29.031571 tst assert_extension.py: using LAC 35226 17:46:29.151835 tst assert_extension.py: using RAC 36 17:46:29.270563 tst assert_extension.py: using CellId 35226 17:46:29.390811 tst assert_extension.py: using BVCI 35227 17:46:29.501905 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:29.622357 tst assert_extension.py:10: start nitb and bts... 17:46:29.841864 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:46:30.501971 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12754): Launched 17:46:30.827222 run osmo-nitb_10.42.42.2(pid=12755): Launched 17:46:31.034456 run osmo-nitb_10.42.42.2(pid=12755): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12755)] 17:46:31.182358 run osmo-nitb_10.42.42.2(pid=12755): stdout: | (launched: 2022-12-13_17:46:30.767878) 17:46:31.332417 run osmo-nitb_10.42.42.2(pid=12755): stderr: | (launched: 2022-12-13_17:46:30.815725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:31.482272 run osmo-nitb_10.42.42.2(pid=12755): stdout: | (launched: 2022-12-13_17:46:30.767878) 17:46:31.626337 run osmo-nitb_10.42.42.2(pid=12755): stderr: | (launched: 2022-12-13_17:46:30.815725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12755): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12755) [trial-2392↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12755)] 17:46:31.976144 tst osmo-nitb_10.42.42.2(pid=12755): stdout: | (launched: 2022-12-13_17:46:30.767878) 17:46:32.109500 tst osmo-nitb_10.42.42.2(pid=12755): stderr: | (launched: 2022-12-13_17:46:30.815725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:32.268074 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12755): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12755) [trial-2392↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12755)] [trial-2392↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 17:46:32.277709 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:46:32.285107 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12754): Terminating (SIGTERM) 17:46:32.497549 --- ParallelTerminationStrategy: PID 12754 died... 17:46:32.520191 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12754): Terminated: ok {rc=0} 17:46:32.610703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:trx-umtrx --------------------------------------------------------------------- 17:46:33.790273 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:33.795131 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:33.828258 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:46:33.855412 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:33.890196 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:33.922950 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:46:33.950371 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:34.477628 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:34.482795 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:34.493554 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:34.540538 tst assert_extension.py: using LAC 35227 17:46:34.668535 tst assert_extension.py: using RAC 37 17:46:34.795779 tst assert_extension.py: using CellId 35227 17:46:34.916450 tst assert_extension.py: using BVCI 35228 17:46:35.028220 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:35.039230 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:35.049938 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:35.060459 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:35.071108 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:35.082116 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:35.202691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:35.705729 run create_hlr_db(pid=12759): Launched 17:46:35.830685 bus /sierra_2: Setting Powered False 17:46:36.894789 run create_hlr_db(pid=12759): Terminated: ok {rc=0} 17:46:37.329965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12761): Launched 17:46:37.633989 run osmo-hlr_10.42.42.2(pid=12762): Launched 17:46:37.750723 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:38.278269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12764): Launched 17:46:38.580480 run osmo-stp_10.42.42.5(pid=12765): Launched 17:46:38.694912 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:39.240133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12767): Launched 17:46:39.541490 run osmo-msc_10.42.42.6(pid=12768): Launched 17:46:39.710472 run osmo-stp_10.42.42.5(pid=12765): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12765)] 17:46:39.838261 run osmo-stp_10.42.42.5(pid=12765): stdout: | (launched: 2022-12-13_17:46:38.524517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:39.966675 run osmo-stp_10.42.42.5(pid=12765): stderr: | [0;m[38;5;43m20221213174638692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174638692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174638693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174638693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174638693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174638694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174638694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:40.092097 run osmo-stp_10.42.42.5(pid=12765): stdout: | (launched: 2022-12-13_17:46:38.524517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:40.212527 run osmo-stp_10.42.42.5(pid=12765): stderr: | [0;m[38;5;43m20221213174638692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174638692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174638693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174638693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174638693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174638694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174638694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:40.356174 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12765): Process ended prematurely: osmo-stp_10.42.42.5(pid=12765) [trial-2392↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12765)] [trial-2392↪ussd:trx-umtrx↪assert_extension.py:17] 17:46:40.364862 tst assert_extension.py:17: Test FAILED (5.9 sec) 17:46:40.391035 run osmo-hlr_10.42.42.2(pid=12762): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12762)] 17:46:40.439331 run osmo-hlr_10.42.42.2(pid=12762): stdout: | (launched: 2022-12-13_17:46:37.577780) 17:46:40.489115 run osmo-hlr_10.42.42.2(pid=12762): stderr: | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174637751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174637764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174637775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174637775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174637775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:40.558248 run osmo-msc_10.42.42.6(pid=12768): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12768)] 17:46:40.606189 run osmo-msc_10.42.42.6(pid=12768): stdout: | (launched: 2022-12-13_17:46:39.485643) 17:46:40.655935 run osmo-msc_10.42.42.6(pid=12768): stderr: | [0;m[38;5;43m20221213174639754 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174639755 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe219519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174639755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174639755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174639755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174639755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174639757 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174639757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174639757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174639757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:40.705884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12761): Terminating (SIGTERM) 17:46:40.745953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12764): Terminating (SIGTERM) 17:46:40.786202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12767): Terminating (SIGTERM) 17:46:40.827071 --- ParallelTerminationStrategy: PID 12761 died... 17:46:40.846776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12761): Terminated: ok {rc=0} 17:46:40.891612 --- ParallelTerminationStrategy: PID 12764 died... 17:46:40.910630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12764): Terminated: ok {rc=0} 17:46:40.955105 --- ParallelTerminationStrategy: PID 12767 died... 17:46:40.974244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12767): Terminated: ok {rc=0} 17:46:41.060886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:46:42.271442 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:42.278136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:46:42.310284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:46:42.337082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:46:42.390251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:46:42.423137 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:46:42.449619 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:46:43.001884 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:46:43.057005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.068714 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:43.139317 tst mo_mt_call.py: using LAC 35228 17:46:43.269800 tst mo_mt_call.py: using RAC 38 17:46:43.404073 tst mo_mt_call.py: using CellId 35228 17:46:43.525595 tst mo_mt_call.py: using BVCI 35229 17:46:43.637883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.649174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.660235 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.671283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.683093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:43.694728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:43.817826 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:43.936193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:44.447222 run create_hlr_db(pid=12773): Launched 17:46:44.574283 bus /sierra_2: Setting Powered False 17:46:45.639379 run create_hlr_db(pid=12773): Terminated: ok {rc=0} 17:46:46.115191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12775): Launched 17:46:46.444101 run osmo-hlr_10.42.42.2(pid=12776): Launched 17:46:46.693646 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:47.364893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12778): Launched 17:46:47.678183 run osmo-stp_10.42.42.5(pid=12779): Launched 17:46:47.795927 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:48.355227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12781): Launched 17:46:48.665396 run osmo-msc_10.42.42.6(pid=12782): Launched 17:46:48.837212 run osmo-stp_10.42.42.5(pid=12779): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12779)] 17:46:48.968151 run osmo-stp_10.42.42.5(pid=12779): stdout: | (launched: 2022-12-13_17:46:47.621152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:49.098810 run osmo-stp_10.42.42.5(pid=12779): stderr: | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174647790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:49.227079 run osmo-stp_10.42.42.5(pid=12779): stdout: | (launched: 2022-12-13_17:46:47.621152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:49.349841 run osmo-stp_10.42.42.5(pid=12779): stderr: | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174647790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174647790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174647791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:49.496536 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12779): Process ended prematurely: osmo-stp_10.42.42.5(pid=12779) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12779)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:46:49.505597 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:46:49.532241 run osmo-hlr_10.42.42.2(pid=12776): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12776)] 17:46:49.581753 run osmo-hlr_10.42.42.2(pid=12776): stdout: | (launched: 2022-12-13_17:46:46.384874) 17:46:49.632274 run osmo-hlr_10.42.42.2(pid=12776): stderr: | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174646818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174646843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174646851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174646851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174646851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:49.703325 run osmo-msc_10.42.42.6(pid=12782): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12782)] 17:46:49.751862 run osmo-msc_10.42.42.6(pid=12782): stdout: | (launched: 2022-12-13_17:46:48.608365) 17:46:49.802491 run osmo-msc_10.42.42.6(pid=12782): stderr: | [0;m[38;5;43m20221213174648879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174648880 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb957846c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174648880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174648880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174648880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174648880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174648882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174648882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174648883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174648883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:49.853220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12775): Terminating (SIGTERM) 17:46:49.893750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12778): Terminating (SIGTERM) 17:46:49.934577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12781): Terminating (SIGTERM) 17:46:49.975503 --- ParallelTerminationStrategy: PID 12775 died... 17:46:49.995298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12775): Terminated: ok {rc=0} 17:46:50.040458 --- ParallelTerminationStrategy: PID 12778 died... 17:46:50.059853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12778): Terminated: ok {rc=0} 17:46:50.104894 --- ParallelTerminationStrategy: PID 12781 died... 17:46:50.124738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12781): Terminated: ok {rc=0} 17:46:50.212574 bus /sierra_3: Setting Powered False 17:46:51.313434 bus /sierra_3: Setting Powered False 17:46:52.430058 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:46:53.584088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:53.596620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:53.671666 tst mo_mt_call_osmux.py: using LAC 35229 17:46:53.800129 tst mo_mt_call_osmux.py: using RAC 39 17:46:53.921729 tst mo_mt_call_osmux.py: using CellId 35229 17:46:54.042367 tst mo_mt_call_osmux.py: using BVCI 35230 17:46:54.155316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:54.166635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:54.177883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:54.189058 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:54.200351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:54.211308 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:54.328683 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:54.451761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:54.961715 run create_hlr_db(pid=12784): Launched 17:46:55.088303 bus /sierra_2: Setting Powered False 17:46:56.153734 run create_hlr_db(pid=12784): Terminated: ok {rc=0} 17:46:56.594358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Launched 17:46:56.902794 run osmo-hlr_10.42.42.2(pid=12787): Launched 17:46:57.021384 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:57.566651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Launched 17:46:57.875543 run osmo-stp_10.42.42.5(pid=12790): Launched 17:46:57.992706 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:58.550214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Launched 17:46:58.858397 run osmo-msc_10.42.42.6(pid=12793): Launched 17:46:59.029761 run osmo-stp_10.42.42.5(pid=12790): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] 17:46:59.159060 run osmo-stp_10.42.42.5(pid=12790): stdout: | (launched: 2022-12-13_17:46:57.818519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:59.289079 run osmo-stp_10.42.42.5(pid=12790): stderr: | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174657989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:59.417336 run osmo-stp_10.42.42.5(pid=12790): stdout: | (launched: 2022-12-13_17:46:57.818519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:59.539323 run osmo-stp_10.42.42.5(pid=12790): stderr: | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174657989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174657989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174657990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:59.685602 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12790): Process ended prematurely: osmo-stp_10.42.42.5(pid=12790) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:46:59.694712 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:46:59.721356 run osmo-hlr_10.42.42.2(pid=12787): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12787)] 17:46:59.769874 run osmo-hlr_10.42.42.2(pid=12787): stdout: | (launched: 2022-12-13_17:46:56.845774) 17:46:59.820317 run osmo-hlr_10.42.42.2(pid=12787): stderr: | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174657029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174657041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174657050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174657050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174657050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:59.890319 run osmo-msc_10.42.42.6(pid=12793): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12793)] 17:46:59.938555 run osmo-msc_10.42.42.6(pid=12793): stdout: | (launched: 2022-12-13_17:46:58.801669) 17:46:59.988363 run osmo-msc_10.42.42.6(pid=12793): stderr: | [0;m[38;5;43m20221213174659074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174659074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03d7229c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174659074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174659074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174659074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174659074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174659076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174659076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174659077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174659077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:00.038961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Terminating (SIGTERM) 17:47:00.078964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Terminating (SIGTERM) 17:47:00.118891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Terminating (SIGTERM) 17:47:00.159168 --- ParallelTerminationStrategy: PID 12786 died... 17:47:00.178773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12786): Terminated: ok {rc=0} 17:47:00.223126 --- ParallelTerminationStrategy: PID 12789 died... 17:47:00.242112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12789): Terminated: ok {rc=0} 17:47:00.286517 --- ParallelTerminationStrategy: PID 12792 died... 17:47:00.305573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12792): Terminated: ok {rc=0} 17:47:00.392310 bus /sierra_3: Setting Powered False 17:47:01.497655 bus /sierra_3: Setting Powered False 17:47:02.614845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:47:03.866399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:03.873732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:47:03.907397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:47:03.936391 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:47:03.989393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:47:04.022860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:47:04.051167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:47:04.602668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:47:04.657388 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:04.669111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:47:04.741399 tst mo_mt_call.py: using LAC 35230 17:47:04.871239 tst mo_mt_call.py: using RAC 40 17:47:05.005683 tst mo_mt_call.py: using CellId 35230 17:47:05.135480 tst mo_mt_call.py: using BVCI 35231 17:47:05.255845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:05.267594 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:05.279081 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:05.290607 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:05.303085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:05.315504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:47:05.435046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:47:05.558671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:06.068873 run create_hlr_db(pid=12799): Launched 17:47:06.194628 bus /sierra_2: Setting Powered False 17:47:07.260249 run create_hlr_db(pid=12799): Terminated: ok {rc=0} 17:47:07.701952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12801): Launched 17:47:08.009648 run osmo-hlr_10.42.42.2(pid=12802): Launched 17:47:08.127379 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:08.670461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12804): Launched 17:47:08.979362 run osmo-stp_10.42.42.5(pid=12805): Launched 17:47:09.096193 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:09.654011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12807): Launched 17:47:09.962894 run osmo-msc_10.42.42.6(pid=12808): Launched 17:47:10.137650 run osmo-stp_10.42.42.5(pid=12805): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12805)] 17:47:10.267826 run osmo-stp_10.42.42.5(pid=12805): stdout: | (launched: 2022-12-13_17:47:08.922235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:10.398112 run osmo-stp_10.42.42.5(pid=12805): stderr: | [0;m[38;5;43m20221213174709090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174709090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174709091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174709091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:10.526545 run osmo-stp_10.42.42.5(pid=12805): stdout: | (launched: 2022-12-13_17:47:08.922235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:10.649172 run osmo-stp_10.42.42.5(pid=12805): stderr: | [0;m[38;5;43m20221213174709090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174709090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174709091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174709091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174709092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:10.795799 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12805): Process ended prematurely: osmo-stp_10.42.42.5(pid=12805) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12805)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:47:10.805565 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:47:10.832367 run osmo-hlr_10.42.42.2(pid=12802): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12802)] 17:47:10.881125 run osmo-hlr_10.42.42.2(pid=12802): stdout: | (launched: 2022-12-13_17:47:07.952774) 17:47:10.931713 run osmo-hlr_10.42.42.2(pid=12802): stderr: | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174708125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174708138 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174708148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174708148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174708148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:11.002122 run osmo-msc_10.42.42.6(pid=12808): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12808)] 17:47:11.050766 run osmo-msc_10.42.42.6(pid=12808): stdout: | (launched: 2022-12-13_17:47:09.905880) 17:47:11.101414 run osmo-msc_10.42.42.6(pid=12808): stderr: | [0;m[38;5;43m20221213174710175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174710175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe52c3f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174710175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174710175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174710175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174710176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174710177 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174710178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174710178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174710178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:11.152188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12801): Terminating (SIGTERM) 17:47:11.192778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12804): Terminating (SIGTERM) 17:47:11.233302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12807): Terminating (SIGTERM) 17:47:11.274081 --- ParallelTerminationStrategy: PID 12801 died... 17:47:11.293815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12801): Terminated: ok {rc=0} 17:47:11.339220 --- ParallelTerminationStrategy: PID 12804 died... 17:47:11.358576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12804): Terminated: ok {rc=0} 17:47:11.403614 --- ParallelTerminationStrategy: PID 12807 died... 17:47:11.422899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12807): Terminated: ok {rc=0} 17:47:11.511117 bus /sierra_3: Setting Powered False 17:47:12.613278 bus /sierra_3: Setting Powered False 17:47:13.730443 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:47:14.877525 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:14.889447 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:47:14.958778 tst mo_mt_call_osmux.py: using LAC 35231 17:47:15.080912 tst mo_mt_call_osmux.py: using RAC 41 17:47:15.202649 tst mo_mt_call_osmux.py: using CellId 35231 17:47:15.325235 tst mo_mt_call_osmux.py: using BVCI 35232 17:47:15.436347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:15.447668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:15.458614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:15.469529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:15.480498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:47:15.491599 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:47:15.609067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:47:15.735125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:16.253317 run create_hlr_db(pid=12810): Launched 17:47:16.414974 bus /sierra_2: Setting Powered False 17:47:17.480036 run create_hlr_db(pid=12810): Terminated: ok {rc=0} 17:47:17.939625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12812): Launched 17:47:18.271315 run osmo-hlr_10.42.42.2(pid=12813): Launched 17:47:18.398019 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:18.966435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12815): Launched 17:47:19.296516 run osmo-stp_10.42.42.5(pid=12816): Launched 17:47:19.423101 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:20.018399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12818): Launched 17:47:20.350517 run osmo-msc_10.42.42.6(pid=12819): Launched 17:47:20.535761 run osmo-stp_10.42.42.5(pid=12816): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12816)] 17:47:20.674792 run osmo-stp_10.42.42.5(pid=12816): stdout: | (launched: 2022-12-13_17:47:19.236177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:20.814630 run osmo-stp_10.42.42.5(pid=12816): stderr: | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174719426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:20.952649 run osmo-stp_10.42.42.5(pid=12816): stdout: | (launched: 2022-12-13_17:47:19.236177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:21.083662 run osmo-stp_10.42.42.5(pid=12816): stderr: | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174719425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174719426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174719426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:21.241309 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12816): Process ended prematurely: osmo-stp_10.42.42.5(pid=12816) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12816)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:47:21.251050 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:47:21.278962 run osmo-hlr_10.42.42.2(pid=12813): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12813)] 17:47:21.330696 run osmo-hlr_10.42.42.2(pid=12813): stdout: | (launched: 2022-12-13_17:47:18.211209) 17:47:21.383384 run osmo-hlr_10.42.42.2(pid=12813): stderr: | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174718408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174718421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174718429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174718429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174718430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:21.456936 run osmo-msc_10.42.42.6(pid=12819): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12819)] 17:47:21.507309 run osmo-msc_10.42.42.6(pid=12819): stdout: | (launched: 2022-12-13_17:47:20.289894) 17:47:21.560463 run osmo-msc_10.42.42.6(pid=12819): stderr: | [0;m[38;5;43m20221213174720612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174720612 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8fd520c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174720613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174720613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174720613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174720613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174720615 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174720615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174720615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174720615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:21.613520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12812): Terminating (SIGTERM) 17:47:21.655569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12815): Terminating (SIGTERM) 17:47:21.698340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12818): Terminating (SIGTERM) 17:47:21.741035 --- ParallelTerminationStrategy: PID 12812 died... 17:47:21.761629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12812): Terminated: ok {rc=0} 17:47:21.808652 --- ParallelTerminationStrategy: PID 12815 died... 17:47:21.828734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12815): Terminated: ok {rc=0} 17:47:21.875503 --- ParallelTerminationStrategy: PID 12818 died... 17:47:21.895591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12818): Terminated: ok {rc=0} 17:47:21.983974 bus /sierra_3: Setting Powered False 17:47:23.085238 bus /sierra_3: Setting Powered False 17:47:24.202669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:47:25.453901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:25.461634 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:47:25.493568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:47:25.520646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:47:25.571414 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:47:25.604004 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:47:25.631155 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:47:26.181832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:47:26.232402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.243771 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:47:26.313735 tst mo_mt_call.py: using LAC 35232 17:47:26.436297 tst mo_mt_call.py: using RAC 42 17:47:26.558757 tst mo_mt_call.py: using CellId 35232 17:47:26.682491 tst mo_mt_call.py: using BVCI 35233 17:47:26.795715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.806814 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.817726 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.828722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.840223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:26.851560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:26.973865 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:27.099568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:27.611476 run create_hlr_db(pid=12824): Launched 17:47:27.737436 bus /sierra_2: Setting Powered False 17:47:28.802853 run create_hlr_db(pid=12824): Terminated: ok {rc=0} 17:47:29.263923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12826): Launched 17:47:29.597256 run osmo-hlr_10.42.42.2(pid=12827): Launched 17:47:29.722304 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:30.294459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12829): Launched 17:47:30.626747 run osmo-stp_10.42.42.5(pid=12830): Launched 17:47:30.754416 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:31.415528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12832): Launched 17:47:31.794304 run osmo-msc_10.42.42.6(pid=12833): Launched 17:47:32.025700 run osmo-stp_10.42.42.5(pid=12830): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12830)] 17:47:32.360470 run osmo-stp_10.42.42.5(pid=12830): stdout: | (launched: 2022-12-13_17:47:30.566321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:32.501555 run osmo-stp_10.42.42.5(pid=12830): stderr: | [0;m[38;5;43m20221213174730755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174730756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174730756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174730756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:32.640339 run osmo-stp_10.42.42.5(pid=12830): stdout: | (launched: 2022-12-13_17:47:30.566321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:32.772085 run osmo-stp_10.42.42.5(pid=12830): stderr: | [0;m[38;5;43m20221213174730755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174730756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174730756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174730756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174730757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:32.930247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12830): Process ended prematurely: osmo-stp_10.42.42.5(pid=12830) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12830)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:47:32.940121 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:47:32.968202 run osmo-hlr_10.42.42.2(pid=12827): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12827)] 17:47:33.019854 run osmo-hlr_10.42.42.2(pid=12827): stdout: | (launched: 2022-12-13_17:47:29.536241) 17:47:33.073501 run osmo-hlr_10.42.42.2(pid=12827): stderr: | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174729734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174729745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174729754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174729754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174729754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:33.147267 run osmo-msc_10.42.42.6(pid=12833): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12833)] 17:47:33.198296 run osmo-msc_10.42.42.6(pid=12833): stdout: | (launched: 2022-12-13_17:47:31.735306) 17:47:33.252086 run osmo-msc_10.42.42.6(pid=12833): stderr: | [0;m[38;5;43m20221213174732240 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174732241 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d236d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174732241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174732241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174732241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174732241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174732243 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174732243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174732243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174732243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:33.305656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12826): Terminating (SIGTERM) 17:47:33.348267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12829): Terminating (SIGTERM) 17:47:33.391019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12832): Terminating (SIGTERM) 17:47:33.434787 --- ParallelTerminationStrategy: PID 12826 died... 17:47:33.455437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12826): Terminated: ok {rc=0} 17:47:33.503153 --- ParallelTerminationStrategy: PID 12829 died... 17:47:33.523450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12829): Terminated: ok {rc=0} 17:47:33.571200 --- ParallelTerminationStrategy: PID 12832 died... 17:47:33.591589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12832): Terminated: ok {rc=0} 17:47:33.682221 bus /sierra_3: Setting Powered False 17:47:34.782591 bus /sierra_3: Setting Powered False 17:47:35.900761 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:47:37.052174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.064420 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:47:37.136180 tst mo_mt_call_osmux.py: using LAC 35233 17:47:37.265394 tst mo_mt_call_osmux.py: using RAC 43 17:47:37.394158 tst mo_mt_call_osmux.py: using CellId 35233 17:47:37.524075 tst mo_mt_call_osmux.py: using BVCI 35234 17:47:37.644631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.656251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.667674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.679127 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.691227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:37.702975 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:37.824425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:37.944395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:38.422237 run create_hlr_db(pid=12836): Launched 17:47:38.550829 bus /sierra_2: Setting Powered False 17:47:39.612010 run create_hlr_db(pid=12836): Terminated: ok {rc=0} 17:47:40.064283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12838): Launched 17:47:40.396894 run osmo-hlr_10.42.42.2(pid=12839): Launched 17:47:40.522999 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:41.094616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12841): Launched 17:47:41.426411 run osmo-stp_10.42.42.5(pid=12842): Launched 17:47:41.553734 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:42.150911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12844): Launched 17:47:42.481481 run osmo-msc_10.42.42.6(pid=12845): Launched 17:47:42.667600 run osmo-stp_10.42.42.5(pid=12842): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12842)] 17:47:42.807178 run osmo-stp_10.42.42.5(pid=12842): stdout: | (launched: 2022-12-13_17:47:41.365845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:42.947420 run osmo-stp_10.42.42.5(pid=12842): stderr: | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174741556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:43.085694 run osmo-stp_10.42.42.5(pid=12842): stdout: | (launched: 2022-12-13_17:47:41.365845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:43.217257 run osmo-stp_10.42.42.5(pid=12842): stderr: | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174741555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174741556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174741556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:43.374546 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12842): Process ended prematurely: osmo-stp_10.42.42.5(pid=12842) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12842)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:47:43.384377 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:47:43.412724 run osmo-hlr_10.42.42.2(pid=12839): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12839)] 17:47:43.464816 run osmo-hlr_10.42.42.2(pid=12839): stdout: | (launched: 2022-12-13_17:47:40.336270) 17:47:43.518326 run osmo-hlr_10.42.42.2(pid=12839): stderr: | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174740535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174740548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174740556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174740556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174740556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:43.594475 run osmo-msc_10.42.42.6(pid=12845): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12845)] 17:47:43.645518 run osmo-msc_10.42.42.6(pid=12845): stdout: | (launched: 2022-12-13_17:47:42.420573) 17:47:43.698725 run osmo-msc_10.42.42.6(pid=12845): stderr: | [0;m[38;5;43m20221213174742742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174742742 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c34e57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174742742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174742742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174742742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174742742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174742744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174742744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174742744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174742745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:43.752257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12838): Terminating (SIGTERM) 17:47:43.795097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12841): Terminating (SIGTERM) 17:47:43.838642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12844): Terminating (SIGTERM) 17:47:43.881815 --- ParallelTerminationStrategy: PID 12838 died... 17:47:43.902725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12838): Terminated: ok {rc=0} 17:47:43.950156 --- ParallelTerminationStrategy: PID 12841 died... 17:47:43.970366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12841): Terminated: ok {rc=0} 17:47:44.017647 --- ParallelTerminationStrategy: PID 12844 died... 17:47:44.037767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12844): Terminated: ok {rc=0} 17:47:44.127722 bus /sierra_3: Setting Powered False 17:47:45.229785 bus /sierra_3: Setting Powered False 17:47:46.357789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:47:47.622438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:47.630399 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:47:47.662934 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:47:47.689940 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:47:47.742481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:47:47.775193 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:47:47.801610 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:47:48.350991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:47:48.400674 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:48.412066 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:48.482070 tst mo_mt_call.py: using LAC 35234 17:47:48.602932 tst mo_mt_call.py: using RAC 44 17:47:48.730209 tst mo_mt_call.py: using CellId 35234 17:47:48.850922 tst mo_mt_call.py: using BVCI 35235 17:47:48.963482 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:48.974621 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:48.986034 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:48.996867 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:49.008191 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:49.019278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:49.135997 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:49.261915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:49.771789 run create_hlr_db(pid=12850): Launched 17:47:49.899254 bus /sierra_2: Setting Powered False 17:47:50.960847 run create_hlr_db(pid=12850): Terminated: ok {rc=0} 17:47:51.421784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12852): Launched 17:47:51.754314 run osmo-hlr_10.42.42.2(pid=12853): Launched 17:47:51.881680 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:52.453542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12855): Launched 17:47:52.785684 run osmo-stp_10.42.42.5(pid=12856): Launched 17:47:52.911148 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:53.509417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12858): Launched 17:47:53.843412 run osmo-msc_10.42.42.6(pid=12859): Launched 17:47:54.027655 run osmo-stp_10.42.42.5(pid=12856): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12856)] 17:47:54.167595 run osmo-stp_10.42.42.5(pid=12856): stdout: | (launched: 2022-12-13_17:47:52.725109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:54.307883 run osmo-stp_10.42.42.5(pid=12856): stderr: | [0;m[38;5;43m20221213174752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174752918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174752918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174752918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:54.446294 run osmo-stp_10.42.42.5(pid=12856): stdout: | (launched: 2022-12-13_17:47:52.725109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:54.578618 run osmo-stp_10.42.42.5(pid=12856): stderr: | [0;m[38;5;43m20221213174752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174752918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174752918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174752918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:54.736084 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12856): Process ended prematurely: osmo-stp_10.42.42.5(pid=12856) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12856)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:47:54.745864 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:47:54.774013 run osmo-hlr_10.42.42.2(pid=12853): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12853)] 17:47:54.825814 run osmo-hlr_10.42.42.2(pid=12853): stdout: | (launched: 2022-12-13_17:47:51.693979) 17:47:54.878934 run osmo-hlr_10.42.42.2(pid=12853): stderr: | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174751890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174751902 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174751911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174751911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174751911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:54.952810 run osmo-msc_10.42.42.6(pid=12859): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12859)] 17:47:55.003951 run osmo-msc_10.42.42.6(pid=12859): stdout: | (launched: 2022-12-13_17:47:53.782694) 17:47:55.057317 run osmo-msc_10.42.42.6(pid=12859): stderr: | [0;m[38;5;43m20221213174754104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174754104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7a3bf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174754105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174754105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174754105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174754105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174754107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174754107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174754107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174754107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:55.110378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12852): Terminating (SIGTERM) 17:47:55.152632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12855): Terminating (SIGTERM) 17:47:55.195435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12858): Terminating (SIGTERM) 17:47:55.238899 --- ParallelTerminationStrategy: PID 12852 died... 17:47:55.259406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12852): Terminated: ok {rc=0} 17:47:55.306831 --- ParallelTerminationStrategy: PID 12855 died... 17:47:55.327093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12855): Terminated: ok {rc=0} 17:47:55.374084 --- ParallelTerminationStrategy: PID 12858 died... 17:47:55.394302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12858): Terminated: ok {rc=0} 17:47:55.483732 bus /sierra_3: Setting Powered False 17:47:56.583645 bus /sierra_3: Setting Powered False 17:47:57.703474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:47:58.852035 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:58.863883 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:58.932485 tst mo_mt_call_osmux.py: using LAC 35235 17:47:59.053824 tst mo_mt_call_osmux.py: using RAC 45 17:47:59.176016 tst mo_mt_call_osmux.py: using CellId 35235 17:47:59.298540 tst mo_mt_call_osmux.py: using BVCI 35236 17:47:59.410223 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:59.421433 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:59.432312 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:59.443546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:59.454525 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:59.465403 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:59.583292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:59.706164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:00.215674 run create_hlr_db(pid=12861): Launched 17:48:00.343174 bus /sierra_2: Setting Powered False 17:48:01.404635 run create_hlr_db(pid=12861): Terminated: ok {rc=0} 17:48:01.882306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12863): Launched 17:48:02.244220 run osmo-hlr_10.42.42.2(pid=12864): Launched 17:48:02.369093 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:02.903466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12866): Launched 17:48:03.213755 run osmo-stp_10.42.42.5(pid=12867): Launched 17:48:03.332896 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:03.894317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12869): Launched 17:48:04.205722 run osmo-msc_10.42.42.6(pid=12870): Launched 17:48:04.379125 run osmo-stp_10.42.42.5(pid=12867): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12867)] 17:48:04.509472 run osmo-stp_10.42.42.5(pid=12867): stdout: | (launched: 2022-12-13_17:48:03.156546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:04.641565 run osmo-stp_10.42.42.5(pid=12867): stderr: | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174803326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:04.770193 run osmo-stp_10.42.42.5(pid=12867): stdout: | (launched: 2022-12-13_17:48:03.156546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:04.892658 run osmo-stp_10.42.42.5(pid=12867): stderr: | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174803325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174803326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174803326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:05.039336 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12867): Process ended prematurely: osmo-stp_10.42.42.5(pid=12867) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12867)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:48:05.048281 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:48:05.074933 run osmo-hlr_10.42.42.2(pid=12864): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12864)] 17:48:05.123599 run osmo-hlr_10.42.42.2(pid=12864): stdout: | (launched: 2022-12-13_17:48:02.183162) 17:48:05.173851 run osmo-hlr_10.42.42.2(pid=12864): stderr: | [0;m[1;31m20221213174802365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174802365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174802365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174802366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174802366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174802366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174802378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174802386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:05.244472 run osmo-msc_10.42.42.6(pid=12870): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12870)] 17:48:05.292799 run osmo-msc_10.42.42.6(pid=12870): stdout: | (launched: 2022-12-13_17:48:04.148456) 17:48:05.343162 run osmo-msc_10.42.42.6(pid=12870): stderr: | [0;m[38;5;43m20221213174804419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174804419 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41295e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174804419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174804419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174804419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174804419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174804421 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174804421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174804422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174804422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:05.393610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12863): Terminating (SIGTERM) 17:48:05.433956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12866): Terminating (SIGTERM) 17:48:05.474269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12869): Terminating (SIGTERM) 17:48:05.514789 --- ParallelTerminationStrategy: PID 12863 died... 17:48:05.534450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12863): Terminated: ok {rc=0} 17:48:05.579087 --- ParallelTerminationStrategy: PID 12866 died... 17:48:05.598335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12866): Terminated: ok {rc=0} 17:48:05.643144 --- ParallelTerminationStrategy: PID 12869 died... 17:48:05.662086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12869): Terminated: ok {rc=0} 17:48:05.748883 bus /sierra_3: Setting Powered False 17:48:06.851378 bus /sierra_3: Setting Powered False 17:48:07.969496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:48:09.223970 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:09.231391 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:48:09.263617 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:48:09.290563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:48:09.343573 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:48:09.377136 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:48:09.403907 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:48:09.951582 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:48:10.000895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.012132 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:48:10.080623 tst mo_mt_call.py: using LAC 35236 17:48:10.201972 tst mo_mt_call.py: using RAC 46 17:48:10.323555 tst mo_mt_call.py: using CellId 35236 17:48:10.454242 tst mo_mt_call.py: using BVCI 35237 17:48:10.567562 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.579022 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.590018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.600898 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.612036 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:10.622816 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:10.745891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:10.867922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:11.378996 run create_hlr_db(pid=12875): Launched 17:48:11.506823 bus /sierra_2: Setting Powered False 17:48:12.572126 run create_hlr_db(pid=12875): Terminated: ok {rc=0} 17:48:13.015674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Launched 17:48:13.349445 run osmo-hlr_10.42.42.2(pid=12878): Launched 17:48:13.476505 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:14.048550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Launched 17:48:14.380842 run osmo-stp_10.42.42.5(pid=12881): Launched 17:48:14.508457 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:15.107538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12883): Launched 17:48:15.438681 run osmo-msc_10.42.42.6(pid=12884): Launched 17:48:15.624271 run osmo-stp_10.42.42.5(pid=12881): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] 17:48:15.764134 run osmo-stp_10.42.42.5(pid=12881): stdout: | (launched: 2022-12-13_17:48:14.320269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:15.906015 run osmo-stp_10.42.42.5(pid=12881): stderr: | [0;m[38;5;43m20221213174814510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174814510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174814511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174814511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:16.094816 run osmo-stp_10.42.42.5(pid=12881): stdout: | (launched: 2022-12-13_17:48:14.320269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:16.231449 run osmo-stp_10.42.42.5(pid=12881): stderr: | [0;m[38;5;43m20221213174814510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174814510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174814511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174814511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174814512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:16.394954 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12881): Process ended prematurely: osmo-stp_10.42.42.5(pid=12881) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:48:16.405994 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:48:16.435765 run osmo-hlr_10.42.42.2(pid=12878): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12878)] 17:48:16.491160 run osmo-hlr_10.42.42.2(pid=12878): stdout: | (launched: 2022-12-13_17:48:13.288460) 17:48:16.546550 run osmo-hlr_10.42.42.2(pid=12878): stderr: | [0;m[1;31m20221213174813485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174813485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174813486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174813486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174813486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174813486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174813498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174813507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174813507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174813507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:16.623466 run osmo-msc_10.42.42.6(pid=12884): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12884)] 17:48:16.677232 run osmo-msc_10.42.42.6(pid=12884): stdout: | (launched: 2022-12-13_17:48:15.377814) 17:48:16.732269 run osmo-msc_10.42.42.6(pid=12884): stderr: | [0;m[38;5;43m20221213174815699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174815699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5944e59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174815699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174815699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174815699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174815699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174815701 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174815701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174815702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174815702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:16.787742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Terminating (SIGTERM) 17:48:16.832214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Terminating (SIGTERM) 17:48:16.878090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12883): Terminating (SIGTERM) 17:48:16.923476 --- ParallelTerminationStrategy: PID 12877 died... 17:48:16.945454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Terminated: ok {rc=0} 17:48:16.994596 --- ParallelTerminationStrategy: PID 12880 died... 17:48:17.016258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Terminated: ok {rc=0} 17:48:17.065187 --- ParallelTerminationStrategy: PID 12883 died... 17:48:17.087063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12883): Terminated: ok {rc=0} 17:48:17.180265 bus /sierra_3: Setting Powered False 17:48:18.284841 bus /sierra_3: Setting Powered False 17:48:19.402444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:48:20.555407 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:20.568153 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:48:20.644283 tst mo_mt_call_osmux.py: using LAC 35237 17:48:20.773748 tst mo_mt_call_osmux.py: using RAC 47 17:48:20.903324 tst mo_mt_call_osmux.py: using CellId 35237 17:48:21.030736 tst mo_mt_call_osmux.py: using BVCI 35238 17:48:21.152340 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:21.163998 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:21.175410 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:21.186830 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:21.198688 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:21.210462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:21.328571 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:21.450724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:21.962970 run create_hlr_db(pid=12886): Launched 17:48:22.088330 bus /sierra_2: Setting Powered False 17:48:23.154124 run create_hlr_db(pid=12886): Terminated: ok {rc=0} 17:48:23.595779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12888): Launched 17:48:23.906111 run osmo-hlr_10.42.42.2(pid=12889): Launched 17:48:24.023854 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:24.566560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12891): Launched 17:48:24.875755 run osmo-stp_10.42.42.5(pid=12892): Launched 17:48:24.992363 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:25.550893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12894): Launched 17:48:25.859646 run osmo-msc_10.42.42.6(pid=12895): Launched 17:48:26.031447 run osmo-stp_10.42.42.5(pid=12892): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12892)] 17:48:26.161202 run osmo-stp_10.42.42.5(pid=12892): stdout: | (launched: 2022-12-13_17:48:24.818545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:26.290866 run osmo-stp_10.42.42.5(pid=12892): stderr: | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174824989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:26.419139 run osmo-stp_10.42.42.5(pid=12892): stdout: | (launched: 2022-12-13_17:48:24.818545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:26.541296 run osmo-stp_10.42.42.5(pid=12892): stderr: | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174824988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174824989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174824989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:26.687660 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12892): Process ended prematurely: osmo-stp_10.42.42.5(pid=12892) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12892)] [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:48:26.696802 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:48:26.724220 run osmo-hlr_10.42.42.2(pid=12889): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12889)] 17:48:26.772722 run osmo-hlr_10.42.42.2(pid=12889): stdout: | (launched: 2022-12-13_17:48:23.848766) 17:48:26.823441 run osmo-hlr_10.42.42.2(pid=12889): stderr: | [0;m[1;31m20221213174824024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174824024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174824024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174824024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174824024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174824025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174824037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174824045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174824045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174824045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:26.893395 run osmo-msc_10.42.42.6(pid=12895): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12895)] 17:48:26.941829 run osmo-msc_10.42.42.6(pid=12895): stdout: | (launched: 2022-12-13_17:48:25.802403) 17:48:26.991462 run osmo-msc_10.42.42.6(pid=12895): stderr: | [0;m[38;5;43m20221213174826074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174826074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ddfb28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174826074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174826074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174826075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174826075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174826077 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174826077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174826077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174826077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:27.041593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12888): Terminating (SIGTERM) 17:48:27.081494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12891): Terminating (SIGTERM) 17:48:27.121544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12894): Terminating (SIGTERM) 17:48:27.161924 --- ParallelTerminationStrategy: PID 12888 died... 17:48:27.181543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12888): Terminated: ok {rc=0} 17:48:27.225953 --- ParallelTerminationStrategy: PID 12891 died... 17:48:27.244751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12891): Terminated: ok {rc=0} 17:48:27.289375 --- ParallelTerminationStrategy: PID 12894 died... 17:48:27.308317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12894): Terminated: ok {rc=0} 17:48:27.396376 bus /sierra_3: Setting Powered False 17:48:28.496920 bus /sierra_3: Setting Powered False 17:48:29.614128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:48:30.893711 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:30.901450 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:48:30.952308 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:48:30.983028 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:48:31.042419 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:48:31.087210 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:48:31.119786 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:48:31.653530 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:48:31.735559 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:31.749619 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:31.840587 tst mo_mt_call.py: using LAC 35238 17:48:31.996413 tst mo_mt_call.py: using RAC 48 17:48:32.173576 tst mo_mt_call.py: using CellId 35238 17:48:32.321037 tst mo_mt_call.py: using BVCI 35239 17:48:32.433328 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:32.444464 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:32.455450 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:32.466322 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:32.477372 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:32.488302 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:32.612019 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:32.732041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:33.210760 run create_hlr_db(pid=12900): Launched 17:48:33.338742 bus /sierra_2: Setting Powered False 17:48:34.400440 run create_hlr_db(pid=12900): Terminated: ok {rc=0} 17:48:34.850865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12902): Launched 17:48:35.182796 run osmo-hlr_10.42.42.2(pid=12903): Launched 17:48:35.309900 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:35.880304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12905): Launched 17:48:36.211861 run osmo-stp_10.42.42.5(pid=12906): Launched 17:48:36.338822 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:36.936011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12908): Launched 17:48:37.268484 run osmo-msc_10.42.42.6(pid=12909): Launched 17:48:37.454250 run osmo-stp_10.42.42.5(pid=12906): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12906)] 17:48:37.595648 run osmo-stp_10.42.42.5(pid=12906): stdout: | (launched: 2022-12-13_17:48:36.151439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:37.736648 run osmo-stp_10.42.42.5(pid=12906): stderr: | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174836342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:37.875519 run osmo-stp_10.42.42.5(pid=12906): stdout: | (launched: 2022-12-13_17:48:36.151439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:38.007269 run osmo-stp_10.42.42.5(pid=12906): stderr: | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174836341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174836342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174836342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:38.165123 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12906): Process ended prematurely: osmo-stp_10.42.42.5(pid=12906) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12906)] [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:48:38.174882 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:48:38.202952 run osmo-hlr_10.42.42.2(pid=12903): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12903)] 17:48:38.254431 run osmo-hlr_10.42.42.2(pid=12903): stdout: | (launched: 2022-12-13_17:48:35.122734) 17:48:38.307999 run osmo-hlr_10.42.42.2(pid=12903): stderr: | [0;m[1;31m20221213174835318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174835318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174835319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174835319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174835319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174835319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174835332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174835341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174835341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174835341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:38.382226 run osmo-msc_10.42.42.6(pid=12909): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12909)] 17:48:38.433235 run osmo-msc_10.42.42.6(pid=12909): stdout: | (launched: 2022-12-13_17:48:37.207982) 17:48:38.486125 run osmo-msc_10.42.42.6(pid=12909): stderr: | [0;m[38;5;43m20221213174837529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174837529 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5fd5703c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174837529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174837529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174837529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174837530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174837531 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174837532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174837532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174837532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:38.539273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12902): Terminating (SIGTERM) 17:48:38.582678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12905): Terminating (SIGTERM) 17:48:38.625757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12908): Terminating (SIGTERM) 17:48:38.669099 --- ParallelTerminationStrategy: PID 12902 died... 17:48:38.690016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12902): Terminated: ok {rc=0} 17:48:38.737838 --- ParallelTerminationStrategy: PID 12905 died... 17:48:38.758181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12905): Terminated: ok {rc=0} 17:48:38.805498 --- ParallelTerminationStrategy: PID 12908 died... 17:48:38.826237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12908): Terminated: ok {rc=0} 17:48:38.917127 bus /sierra_3: Setting Powered False 17:48:40.016250 bus /sierra_3: Setting Powered False 17:48:41.134775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:48:42.280775 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.292601 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:42.361807 tst mo_mt_call_osmux.py: using LAC 35239 17:48:42.484428 tst mo_mt_call_osmux.py: using RAC 49 17:48:42.607615 tst mo_mt_call_osmux.py: using CellId 35239 17:48:42.730158 tst mo_mt_call_osmux.py: using BVCI 35240 17:48:42.842926 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.854169 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.865190 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.876138 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.887232 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:42.898216 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:43.016079 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:43.139366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:43.651777 run create_hlr_db(pid=12911): Launched 17:48:43.778398 bus /sierra_2: Setting Powered False 17:48:44.843860 run create_hlr_db(pid=12911): Terminated: ok {rc=0} 17:48:45.286319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Launched 17:48:45.596385 run osmo-hlr_10.42.42.2(pid=12914): Launched 17:48:45.713285 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:46.345782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Launched 17:48:46.705753 run osmo-stp_10.42.42.5(pid=12917): Launched 17:48:46.954162 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:47.614230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12919): Launched 17:48:47.947684 run osmo-msc_10.42.42.6(pid=12920): Launched 17:48:48.132756 run osmo-stp_10.42.42.5(pid=12917): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] 17:48:48.271516 run osmo-stp_10.42.42.5(pid=12917): stdout: | (launched: 2022-12-13_17:48:46.639376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:48.411984 run osmo-stp_10.42.42.5(pid=12917): stderr: | [0;m[38;5;43m20221213174846943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174846944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174846944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174846944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:48.550228 run osmo-stp_10.42.42.5(pid=12917): stdout: | (launched: 2022-12-13_17:48:46.639376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:48.682434 run osmo-stp_10.42.42.5(pid=12917): stderr: | [0;m[38;5;43m20221213174846943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174846944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174846944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174846944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174846945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:48.840219 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12917): Process ended prematurely: osmo-stp_10.42.42.5(pid=12917) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:48:48.850241 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:48:48.878442 run osmo-hlr_10.42.42.2(pid=12914): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12914)] 17:48:48.930419 run osmo-hlr_10.42.42.2(pid=12914): stdout: | (launched: 2022-12-13_17:48:45.539542) 17:48:48.983694 run osmo-hlr_10.42.42.2(pid=12914): stderr: | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174845716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174845727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174845735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174845735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174845736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:49.057481 run osmo-msc_10.42.42.6(pid=12920): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12920)] 17:48:49.108301 run osmo-msc_10.42.42.6(pid=12920): stdout: | (launched: 2022-12-13_17:48:47.887145) 17:48:49.161519 run osmo-msc_10.42.42.6(pid=12920): stderr: | [0;m[38;5;43m20221213174848207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174848207 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54141edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174848207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174848207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174848207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174848208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174848209 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174848210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174848211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174848211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:49.214876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Terminating (SIGTERM) 17:48:49.257551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Terminating (SIGTERM) 17:48:49.300781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12919): Terminating (SIGTERM) 17:48:49.344224 --- ParallelTerminationStrategy: PID 12913 died... 17:48:49.365250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Terminated: ok {rc=0} 17:48:49.412605 --- ParallelTerminationStrategy: PID 12916 died... 17:48:49.433548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Terminated: ok {rc=0} 17:48:49.480768 --- ParallelTerminationStrategy: PID 12919 died... 17:48:49.501562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12919): Terminated: ok {rc=0} 17:48:49.591700 bus /sierra_3: Setting Powered False 17:48:50.689791 bus /sierra_3: Setting Powered False 17:48:51.807487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:48:53.059166 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:53.065946 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:48:53.099876 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:48:53.128372 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:48:53.180936 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:48:53.214539 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:48:53.242299 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:48:53.797271 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:48:53.851799 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:53.863199 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:48:53.933396 tst mo_mt_call.py: using LAC 35240 17:48:54.061589 tst mo_mt_call.py: using RAC 50 17:48:54.191381 tst mo_mt_call.py: using CellId 35240 17:48:54.319221 tst mo_mt_call.py: using BVCI 35241 17:48:54.440571 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:54.452000 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:54.463282 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:54.474488 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:54.486033 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:54.497499 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:54.615956 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:54.738541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:55.252499 run create_hlr_db(pid=12927): Launched 17:48:55.379866 bus /sierra_2: Setting Powered False 17:48:56.446019 run create_hlr_db(pid=12927): Terminated: ok {rc=0} 17:48:56.889745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Launched 17:48:57.199659 run osmo-hlr_10.42.42.2(pid=12930): Launched 17:48:57.317526 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:57.849702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Launched 17:48:58.158805 run osmo-stp_10.42.42.5(pid=12933): Launched 17:48:58.276459 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:58.834472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Launched 17:48:59.146359 run osmo-msc_10.42.42.6(pid=12936): Launched 17:48:59.320590 run osmo-stp_10.42.42.5(pid=12933): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] 17:48:59.452063 run osmo-stp_10.42.42.5(pid=12933): stdout: | (launched: 2022-12-13_17:48:58.101880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:59.582715 run osmo-stp_10.42.42.5(pid=12933): stderr: | [0;m[38;5;43m20221213174858270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174858271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174858271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174858271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:59.711137 run osmo-stp_10.42.42.5(pid=12933): stdout: | (launched: 2022-12-13_17:48:58.101880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:59.833408 run osmo-stp_10.42.42.5(pid=12933): stderr: | [0;m[38;5;43m20221213174858270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174858271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174858271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174858271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174858272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:59.980246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12933): Process ended prematurely: osmo-stp_10.42.42.5(pid=12933) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:48:59.989177 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:49:00.015755 run osmo-hlr_10.42.42.2(pid=12930): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12930)] 17:49:00.064400 run osmo-hlr_10.42.42.2(pid=12930): stdout: | (launched: 2022-12-13_17:48:57.142579) 17:49:00.114593 run osmo-hlr_10.42.42.2(pid=12930): stderr: | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174857319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174857337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174857346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174857346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174857346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:00.185257 run osmo-msc_10.42.42.6(pid=12936): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12936)] 17:49:00.233935 run osmo-msc_10.42.42.6(pid=12936): stdout: | (launched: 2022-12-13_17:48:59.089188) 17:49:00.284091 run osmo-msc_10.42.42.6(pid=12936): stderr: | [0;m[38;5;43m20221213174859359 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174859359 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ec3718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174859359 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174859359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174859359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174859359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174859361 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174859362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174859362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174859362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:00.335043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Terminating (SIGTERM) 17:49:00.375497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Terminating (SIGTERM) 17:49:00.415834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Terminating (SIGTERM) 17:49:00.456420 --- ParallelTerminationStrategy: PID 12929 died... 17:49:00.475815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Terminated: ok {rc=0} 17:49:00.520553 --- ParallelTerminationStrategy: PID 12932 died... 17:49:00.539588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Terminated: ok {rc=0} 17:49:00.583978 --- ParallelTerminationStrategy: PID 12935 died... 17:49:00.602847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Terminated: ok {rc=0} 17:49:00.689326 bus /sierra_3: Setting Powered False 17:49:01.810691 bus /sierra_3: Setting Powered False 17:49:02.943915 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:49:04.092826 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.104454 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:49:04.174393 tst mo_mt_call_osmux.py: using LAC 35241 17:49:04.295975 tst mo_mt_call_osmux.py: using RAC 51 17:49:04.418536 tst mo_mt_call_osmux.py: using CellId 35241 17:49:04.548188 tst mo_mt_call_osmux.py: using BVCI 35242 17:49:04.669562 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.681199 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.692591 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.703985 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.715886 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:49:04.727579 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:49:04.847487 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:49:04.971004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:05.481888 run create_hlr_db(pid=12938): Launched 17:49:05.609275 bus /sierra_2: Setting Powered False 17:49:06.673993 run create_hlr_db(pid=12938): Terminated: ok {rc=0} 17:49:07.115838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12940): Launched 17:49:07.425183 run osmo-hlr_10.42.42.2(pid=12941): Launched 17:49:07.543188 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:08.086561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12943): Launched 17:49:08.395872 run osmo-stp_10.42.42.5(pid=12944): Launched 17:49:08.513258 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:09.080047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12946): Launched 17:49:09.391226 run osmo-msc_10.42.42.6(pid=12947): Launched 17:49:09.564209 run osmo-stp_10.42.42.5(pid=12944): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12944)] 17:49:09.694342 run osmo-stp_10.42.42.5(pid=12944): stdout: | (launched: 2022-12-13_17:49:08.338662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:09.825366 run osmo-stp_10.42.42.5(pid=12944): stderr: | [0;m[38;5;43m20221213174908508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174908509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174908509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174908509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:09.954002 run osmo-stp_10.42.42.5(pid=12944): stdout: | (launched: 2022-12-13_17:49:08.338662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:10.076521 run osmo-stp_10.42.42.5(pid=12944): stderr: | [0;m[38;5;43m20221213174908508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174908509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174908509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174908509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174908510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:10.223407 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12944): Process ended prematurely: osmo-stp_10.42.42.5(pid=12944) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12944)] [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:49:10.232356 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:49:10.259138 run osmo-hlr_10.42.42.2(pid=12941): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12941)] 17:49:10.307583 run osmo-hlr_10.42.42.2(pid=12941): stdout: | (launched: 2022-12-13_17:49:07.368104) 17:49:10.357798 run osmo-hlr_10.42.42.2(pid=12941): stderr: | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174907544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174907557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174907565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174907565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174907565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:10.427662 run osmo-msc_10.42.42.6(pid=12947): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12947)] 17:49:10.476199 run osmo-msc_10.42.42.6(pid=12947): stdout: | (launched: 2022-12-13_17:49:09.333572) 17:49:10.526433 run osmo-msc_10.42.42.6(pid=12947): stderr: | [0;m[38;5;43m20221213174909606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174909607 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb54723c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174909607 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174909607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174909607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174909607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174909609 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174909609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174909610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174909610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:10.577487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12940): Terminating (SIGTERM) 17:49:10.617863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12943): Terminating (SIGTERM) 17:49:10.658016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12946): Terminating (SIGTERM) 17:49:10.698549 --- ParallelTerminationStrategy: PID 12940 died... 17:49:10.718043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12940): Terminated: ok {rc=0} 17:49:10.762856 --- ParallelTerminationStrategy: PID 12943 died... 17:49:10.781749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12943): Terminated: ok {rc=0} 17:49:10.826260 --- ParallelTerminationStrategy: PID 12946 died... 17:49:10.845166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12946): Terminated: ok {rc=0} 17:49:10.932025 bus /sierra_3: Setting Powered False 17:49:12.034346 bus /sierra_3: Setting Powered False 17:49:13.150209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:49:14.400224 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:14.406993 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:49:14.440218 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:49:14.468474 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:49:14.520472 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:49:14.554224 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:49:14.582690 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:49:15.136677 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:49:15.191532 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.203550 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:49:15.258290 tst mo_mt_call.py: using LAC 35242 17:49:15.390024 tst mo_mt_call.py: using RAC 52 17:49:15.520931 tst mo_mt_call.py: using CellId 35242 17:49:15.650548 tst mo_mt_call.py: using BVCI 35243 17:49:15.773135 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.785192 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.796871 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.808492 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.820617 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:15.844061 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:15.994281 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:16.130919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:16.800414 run create_hlr_db(pid=12952): Launched 17:49:16.949541 bus /sierra_2: Setting Powered False 17:49:18.011400 run create_hlr_db(pid=12952): Terminated: ok {rc=0} 17:49:18.463765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Launched 17:49:18.796421 run osmo-hlr_10.42.42.2(pid=12955): Launched 17:49:18.922950 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:19.496760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Launched 17:49:19.829654 run osmo-stp_10.42.42.5(pid=12958): Launched 17:49:19.957733 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:20.559122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12960): Launched 17:49:20.892061 run osmo-msc_10.42.42.6(pid=12961): Launched 17:49:21.078769 run osmo-stp_10.42.42.5(pid=12958): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] 17:49:21.219130 run osmo-stp_10.42.42.5(pid=12958): stdout: | (launched: 2022-12-13_17:49:19.769002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:21.360203 run osmo-stp_10.42.42.5(pid=12958): stderr: | [0;m[38;5;43m20221213174919960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174919960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174919961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174919961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:21.499441 run osmo-stp_10.42.42.5(pid=12958): stdout: | (launched: 2022-12-13_17:49:19.769002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:21.631960 run osmo-stp_10.42.42.5(pid=12958): stderr: | [0;m[38;5;43m20221213174919960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174919960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174919961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174919961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174919962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:21.790186 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12958): Process ended prematurely: osmo-stp_10.42.42.5(pid=12958) [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:49:21.800132 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:49:21.828656 run osmo-hlr_10.42.42.2(pid=12955): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12955)] 17:49:21.880435 run osmo-hlr_10.42.42.2(pid=12955): stdout: | (launched: 2022-12-13_17:49:18.735829) 17:49:21.934127 run osmo-hlr_10.42.42.2(pid=12955): stderr: | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174918932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174918944 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174918954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174918954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174918954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:22.008276 run osmo-msc_10.42.42.6(pid=12961): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12961)] 17:49:22.059015 run osmo-msc_10.42.42.6(pid=12961): stdout: | (launched: 2022-12-13_17:49:20.831121) 17:49:22.112052 run osmo-msc_10.42.42.6(pid=12961): stderr: | [0;m[38;5;43m20221213174921153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174921153 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f0e371c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174921153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174921153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174921154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174921154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174921155 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174921156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174921156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174921156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:22.165453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Terminating (SIGTERM) 17:49:22.207995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Terminating (SIGTERM) 17:49:22.250659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12960): Terminating (SIGTERM) 17:49:22.293714 --- ParallelTerminationStrategy: PID 12954 died... 17:49:22.314611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Terminated: ok {rc=0} 17:49:22.361808 --- ParallelTerminationStrategy: PID 12957 died... 17:49:22.381924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Terminated: ok {rc=0} 17:49:22.429027 --- ParallelTerminationStrategy: PID 12960 died... 17:49:22.449238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12960): Terminated: ok {rc=0} 17:49:22.539753 bus /sierra_3: Setting Powered False 17:49:23.640071 bus /sierra_3: Setting Powered False 17:49:24.760733 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:49:25.909594 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:25.921578 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:49:25.972185 tst mo_mt_call_osmux.py: using LAC 35243 17:49:26.094799 tst mo_mt_call_osmux.py: using RAC 53 17:49:26.217135 tst mo_mt_call_osmux.py: using CellId 35243 17:49:26.339363 tst mo_mt_call_osmux.py: using BVCI 35244 17:49:26.452754 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:26.464079 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:26.475067 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:26.486058 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:26.497233 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:26.508281 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:26.625747 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:26.749065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:27.261789 run create_hlr_db(pid=12963): Launched 17:49:27.390582 bus /sierra_2: Setting Powered False 17:49:28.456157 run create_hlr_db(pid=12963): Terminated: ok {rc=0} 17:49:28.898762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Launched 17:49:29.210936 run osmo-hlr_10.42.42.2(pid=12966): Launched 17:49:29.330979 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:29.880221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Launched 17:49:30.189769 run osmo-stp_10.42.42.5(pid=12969): Launched 17:49:30.306863 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:30.874003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Launched 17:49:31.235869 run osmo-msc_10.42.42.6(pid=12972): Launched 17:49:31.650600 run osmo-stp_10.42.42.5(pid=12969): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] 17:49:31.874340 run osmo-stp_10.42.42.5(pid=12969): stdout: | (launched: 2022-12-13_17:49:30.132541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:32.011276 run osmo-stp_10.42.42.5(pid=12969): stderr: | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174930303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174930303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174930304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174930304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:32.144879 run osmo-stp_10.42.42.5(pid=12969): stdout: | (launched: 2022-12-13_17:49:30.132541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:32.270757 run osmo-stp_10.42.42.5(pid=12969): stderr: | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174930302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174930303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174930303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174930304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174930304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:32.420024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12969): Process ended prematurely: osmo-stp_10.42.42.5(pid=12969) [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:49:32.429028 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:49:32.455608 run osmo-hlr_10.42.42.2(pid=12966): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12966)] 17:49:32.503696 run osmo-hlr_10.42.42.2(pid=12966): stdout: | (launched: 2022-12-13_17:49:29.153121) 17:49:32.553870 run osmo-hlr_10.42.42.2(pid=12966): stderr: | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174929330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174929343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174929351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174929352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174929352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:32.623576 run osmo-msc_10.42.42.6(pid=12972): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12972)] 17:49:32.671803 run osmo-msc_10.42.42.6(pid=12972): stdout: | (launched: 2022-12-13_17:49:31.172935) 17:49:32.721676 run osmo-msc_10.42.42.6(pid=12972): stderr: | [0;m[38;5;43m20221213174931564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174931564 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f07ad5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174931573 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174931573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174931573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174931573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174931575 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174931576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174931576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174931576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:32.772080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Terminating (SIGTERM) 17:49:32.811997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Terminating (SIGTERM) 17:49:32.851959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Terminating (SIGTERM) 17:49:32.892193 --- ParallelTerminationStrategy: PID 12965 died... 17:49:32.911522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Terminated: ok {rc=0} 17:49:32.955842 --- ParallelTerminationStrategy: PID 12968 died... 17:49:32.974661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Terminated: ok {rc=0} 17:49:33.018810 --- ParallelTerminationStrategy: PID 12971 died... 17:49:33.037735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Terminated: ok {rc=0} 17:49:33.124234 bus /sierra_3: Setting Powered False 17:49:34.224687 bus /sierra_3: Setting Powered False 17:49:35.340460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:trx-umtrx --------------------------------------------------------------------- 17:49:36.588304 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:36.592937 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:49:36.625135 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:49:36.651659 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:49:36.733986 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:49:36.766132 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:49:36.792364 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:49:37.381814 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 17:49:37.387310 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.398921 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:37.449180 tst emergency_mo_mt_call.py: using LAC 35244 17:49:37.568056 tst emergency_mo_mt_call.py: using RAC 54 17:49:37.686483 tst emergency_mo_mt_call.py: using CellId 35244 17:49:37.803465 tst emergency_mo_mt_call.py: using BVCI 35245 17:49:37.913608 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.924248 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.934812 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.945229 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.955592 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:37.965994 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:38.083192 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:38.201818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:38.672183 run create_hlr_db(pid=12977): Launched 17:49:38.799447 bus /sierra_2: Setting Powered False 17:49:39.863727 run create_hlr_db(pid=12977): Terminated: ok {rc=0} 17:49:40.318468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Launched 17:49:40.646960 run osmo-hlr_10.42.42.2(pid=12980): Launched 17:49:40.773015 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:41.338463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Launched 17:49:41.666624 run osmo-stp_10.42.42.5(pid=12983): Launched 17:49:41.802520 tst emergency_mo_mt_call.py: using MSISDN 8253 17:49:41.970603 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:42.558301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Launched 17:49:42.886763 run osmo-msc_10.42.42.6(pid=12986): Launched 17:49:43.070150 run osmo-stp_10.42.42.5(pid=12983): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] 17:49:43.208135 run osmo-stp_10.42.42.5(pid=12983): stdout: | (launched: 2022-12-13_17:49:41.605941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:43.346953 run osmo-stp_10.42.42.5(pid=12983): stderr: | [0;m[38;5;43m20221213174941795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174941795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174941796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174941796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:43.484124 run osmo-stp_10.42.42.5(pid=12983): stdout: | (launched: 2022-12-13_17:49:41.605941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:43.615375 run osmo-stp_10.42.42.5(pid=12983): stderr: | [0;m[38;5;43m20221213174941795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174941795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174941796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174941796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174941797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:43.771521 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12983): Process ended prematurely: osmo-stp_10.42.42.5(pid=12983) [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 17:49:43.780669 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 17:49:43.808547 run osmo-hlr_10.42.42.2(pid=12980): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12980)] 17:49:43.860154 run osmo-hlr_10.42.42.2(pid=12980): stdout: | (launched: 2022-12-13_17:49:40.586957) 17:49:43.912840 run osmo-hlr_10.42.42.2(pid=12980): stderr: | [0;m[1;31m20221213174940783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174940783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174940783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174940784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174940784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174940784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174940795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174940804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174940804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174940804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:43.986765 run osmo-msc_10.42.42.6(pid=12986): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12986)] 17:49:44.037772 run osmo-msc_10.42.42.6(pid=12986): stdout: | (launched: 2022-12-13_17:49:42.826783) 17:49:44.090801 run osmo-msc_10.42.42.6(pid=12986): stderr: | [0;m[38;5;43m20221213174943147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174943147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc14fe79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174943147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174943147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174943147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174943147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174943149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174943150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174943150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174943150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:44.144093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Terminating (SIGTERM) 17:49:44.186553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Terminating (SIGTERM) 17:49:44.229805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Terminating (SIGTERM) 17:49:44.272881 --- ParallelTerminationStrategy: PID 12979 died... 17:49:44.293939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Terminated: ok {rc=0} 17:49:44.341272 --- ParallelTerminationStrategy: PID 12982 died... 17:49:44.362071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Terminated: ok {rc=0} 17:49:44.409133 --- ParallelTerminationStrategy: PID 12985 died... 17:49:44.429379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Terminated: ok {rc=0} 17:49:44.518190 bus /sierra_3: Setting Powered False 17:49:45.617350 bus /sierra_3: Setting Powered False 17:49:46.751751 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 17:49:47.852081 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:47.863511 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:47.913405 tst emergency_preemptive_call.py: using LAC 35245 17:49:48.031881 tst emergency_preemptive_call.py: using RAC 55 17:49:48.151978 tst emergency_preemptive_call.py: using CellId 35245 17:49:48.270624 tst emergency_preemptive_call.py: using BVCI 35246 17:49:48.382281 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:48.393003 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:48.403491 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:48.413983 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:48.424341 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:48.434845 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:48.557651 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:48.676118 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:48.796928 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:48.915891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:49.388678 run create_hlr_db(pid=12988): Launched 17:49:49.512837 bus /sierra_2: Setting Powered False 17:49:50.574017 run create_hlr_db(pid=12988): Terminated: ok {rc=0} 17:49:50.999224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Launched 17:49:51.303342 run osmo-hlr_10.42.42.2(pid=12991): Launched 17:49:51.419049 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:51.959790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Launched 17:49:52.265222 run osmo-stp_10.42.42.5(pid=12994): Launched 17:49:52.391203 tst emergency_preemptive_call.py: using MSISDN 8254 17:49:52.553801 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:53.100168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Launched 17:49:53.404759 run osmo-msc_10.42.42.6(pid=12997): Launched 17:49:53.574263 run osmo-stp_10.42.42.5(pid=12994): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] 17:49:53.702849 run osmo-stp_10.42.42.5(pid=12994): stdout: | (launched: 2022-12-13_17:49:52.208604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:53.831609 run osmo-stp_10.42.42.5(pid=12994): stderr: | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174952377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:53.958313 run osmo-stp_10.42.42.5(pid=12994): stdout: | (launched: 2022-12-13_17:49:52.208604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:54.079068 run osmo-stp_10.42.42.5(pid=12994): stderr: | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213174952377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213174952377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213174952378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:54.223446 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12994): Process ended prematurely: osmo-stp_10.42.42.5(pid=12994) [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 17:49:54.231920 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 17:49:54.258220 run osmo-hlr_10.42.42.2(pid=12991): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12991)] 17:49:54.306744 run osmo-hlr_10.42.42.2(pid=12991): stdout: | (launched: 2022-12-13_17:49:51.247066) 17:49:54.356551 run osmo-hlr_10.42.42.2(pid=12991): stderr: | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213174951424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213174951436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213174951445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213174951445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213174951445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:54.426468 run osmo-msc_10.42.42.6(pid=12997): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12997)] 17:49:54.474726 run osmo-msc_10.42.42.6(pid=12997): stdout: | (launched: 2022-12-13_17:49:53.347879) 17:49:54.524594 run osmo-msc_10.42.42.6(pid=12997): stderr: | [0;m[38;5;43m20221213174953622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213174953622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42fd862c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213174953622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213174953622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213174953622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213174953622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213174953624 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213174953625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213174953625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213174953625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:54.574442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Terminating (SIGTERM) 17:49:54.614371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Terminating (SIGTERM) 17:49:54.654332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Terminating (SIGTERM) 17:49:54.694481 --- ParallelTerminationStrategy: PID 12990 died... 17:49:54.713355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Terminated: ok {rc=0} 17:49:54.757787 --- ParallelTerminationStrategy: PID 12993 died... 17:49:54.776499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Terminated: ok {rc=0} 17:49:54.820696 --- ParallelTerminationStrategy: PID 12996 died... 17:49:54.839496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Terminated: ok {rc=0} 17:49:54.923623 bus /sierra_9: Setting Powered False 17:49:56.023234 bus /sierra_9: Setting Powered False 17:49:57.141354 bus /sierra_8: Setting Powered False 17:49:58.240998 bus /sierra_8: Setting Powered False 17:49:59.358728 bus /sierra_3: Setting Powered False 17:50:00.457161 bus /sierra_3: Setting Powered False 17:50:01.579514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx --------------------------------------------------------------------- 17:50:02.866271 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:50:02.871189 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:50:02.904320 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 17:50:02.945123 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:50:03.032449 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:50:03.066038 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 17:50:03.105650 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:50:03.698636 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 17:50:03.753231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:03.764202 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:03.811730 tst cs_paging_gprs_active.py: using LAC 35246 17:50:03.939887 tst cs_paging_gprs_active.py: using RAC 56 17:50:04.072529 tst cs_paging_gprs_active.py: using CellId 35246 17:50:04.202238 tst cs_paging_gprs_active.py: using BVCI 35247 17:50:04.323127 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.334391 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.345440 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.356272 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.367410 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.378544 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.389847 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.400915 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:04.412373 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:04.530883 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:04.652249 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:50:04.877084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:05.211636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13006): Launched 17:50:05.503495 run iperf3-srv_10.42.42.10(pid=13007): Launched 17:50:05.630426 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:50:05.855073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:06.190290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13008): Launched 17:50:06.481019 run iperf3-srv_10.42.42.10(pid=13009): Launched 17:50:06.606124 tst cs_paging_gprs_active.py:38: start network... 17:50:06.831737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:07.347246 run create_hlr_db(pid=13010): Launched 17:50:07.474739 bus /sierra_2: Setting Powered False 17:50:08.540726 run create_hlr_db(pid=13010): Terminated: ok {rc=0} 17:50:08.985465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13012): Launched 17:50:09.297894 run osmo-hlr_10.42.42.2(pid=13013): Launched 17:50:09.418729 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:09.959289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13015): Launched 17:50:10.270620 run osmo-stp_10.42.42.5(pid=13016): Launched 17:50:10.388195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:10.922406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13018): Launched 17:50:11.043327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:11.306166 run patchelf(pid=13019): Launched 17:50:11.480735 run osmo-stp_10.42.42.5(pid=13016): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13016)] 17:50:11.613153 run osmo-stp_10.42.42.5(pid=13016): stdout: | (launched: 2022-12-13_17:50:10.213110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:11.746260 run osmo-stp_10.42.42.5(pid=13016): stderr: | [0;m[38;5;43m20221213175010384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175010384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175010385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175010385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175010385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175010386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175010386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:11.879045 run osmo-stp_10.42.42.5(pid=13016): stdout: | (launched: 2022-12-13_17:50:10.213110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:12.006297 run osmo-stp_10.42.42.5(pid=13016): stderr: | [0;m[38;5;43m20221213175010384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175010384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175010385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175010385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175010385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175010386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175010386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:12.157075 run patchelf(pid=13019): Terminating (SIGINT) 17:50:12.333456 run patchelf(pid=13019): Terminated: ok {rc=0} 17:50:12.460733 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13016): Process ended prematurely: osmo-stp_10.42.42.5(pid=13016) [trial-2392↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13016)] [trial-2392↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 17:50:12.470413 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:50:12.497812 run osmo-hlr_10.42.42.2(pid=13013): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13013)] 17:50:12.546183 run osmo-hlr_10.42.42.2(pid=13013): stdout: | (launched: 2022-12-13_17:50:09.240058) 17:50:12.596212 run osmo-hlr_10.42.42.2(pid=13013): stderr: | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175009416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175009428 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175009436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175009437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175009437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:12.646822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13006): Terminating (SIGTERM) 17:50:12.687544 run iperf3-srv_10.42.42.10(pid=13007): Terminating (SIGTERM) 17:50:12.727916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13008): Terminating (SIGTERM) 17:50:12.768340 run iperf3-srv_10.42.42.10(pid=13009): Terminating (SIGTERM) 17:50:12.808612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13012): Terminating (SIGTERM) 17:50:12.849128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13015): Terminating (SIGTERM) 17:50:12.889651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13018): Terminating (SIGTERM) 17:50:12.930562 --- ParallelTerminationStrategy: PID 13006 died... 17:50:12.950066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13006): Terminated: ok {rc=0} 17:50:12.994728 --- ParallelTerminationStrategy: PID 13007 died... 17:50:13.013590 run iperf3-srv_10.42.42.10(pid=13007): Terminated {rc=256} 17:50:13.057873 --- ParallelTerminationStrategy: PID 13008 died... 17:50:13.076605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13008): Terminated: ok {rc=0} 17:50:13.121465 --- ParallelTerminationStrategy: PID 13009 died... 17:50:13.140278 run iperf3-srv_10.42.42.10(pid=13009): Terminated {rc=256} 17:50:13.185038 --- ParallelTerminationStrategy: PID 13012 died... 17:50:13.203960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13012): Terminated: ok {rc=0} 17:50:13.249058 --- ParallelTerminationStrategy: PID 13015 died... 17:50:13.268165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13015): Terminated: ok {rc=0} 17:50:13.312667 --- ParallelTerminationStrategy: PID 13018 died... 17:50:13.331659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13018): Terminated: ok {rc=0} 17:50:13.416722 bus /gobi_0: Setting Powered False 17:50:14.517009 bus /gobi_0: Setting Powered False 17:50:15.634656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx iperf3.py ---------------------------------------------- 17:50:16.786896 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:16.799684 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:16.854981 tst iperf3.py: using LAC 35247 17:50:16.989043 tst iperf3.py: using RAC 57 17:50:17.111541 tst iperf3.py: using CellId 35247 17:50:17.251352 tst iperf3.py: using BVCI 35248 17:50:17.372337 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.383520 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.394427 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.405381 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.416442 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.427651 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.438931 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.450156 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:17.461462 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:17.581615 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:17.790847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:18.102477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Launched 17:50:18.375301 run iperf3-srv_10.42.42.10(pid=13021): Launched 17:50:18.491042 tst iperf3.py:8: start network... 17:50:18.698513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:19.177226 run create_hlr_db(pid=13022): Launched 17:50:19.303538 bus /gobi_6: Setting Powered False 17:50:20.364540 run create_hlr_db(pid=13022): Terminated: ok {rc=0} 17:50:20.818334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Launched 17:50:21.152714 run osmo-hlr_10.42.42.2(pid=13025): Launched 17:50:21.281739 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:21.856873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Launched 17:50:22.190905 run osmo-stp_10.42.42.5(pid=13028): Launched 17:50:22.318620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:22.891604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Launched 17:50:23.020802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:23.302795 run patchelf(pid=13031): Launched 17:50:23.489587 run osmo-stp_10.42.42.5(pid=13028): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] 17:50:23.630939 run osmo-stp_10.42.42.5(pid=13028): stdout: | (launched: 2022-12-13_17:50:22.129865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:23.773583 run osmo-stp_10.42.42.5(pid=13028): stderr: | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175022323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:23.915857 run osmo-stp_10.42.42.5(pid=13028): stdout: | (launched: 2022-12-13_17:50:22.129865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:24.051560 run osmo-stp_10.42.42.5(pid=13028): stderr: | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175022322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175022323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175022323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:24.212599 run patchelf(pid=13031): Terminating (SIGINT) 17:50:24.401198 run patchelf(pid=13031): Terminated: ok {rc=0} 17:50:24.536742 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13028): Process ended prematurely: osmo-stp_10.42.42.5(pid=13028) [trial-2392↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] [trial-2392↪gprs:trx-umtrx↪iperf3.py:8] 17:50:24.547085 tst iperf3.py:8: Test FAILED (7.8 sec) 17:50:24.576009 run osmo-hlr_10.42.42.2(pid=13025): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13025)] 17:50:24.627314 run osmo-hlr_10.42.42.2(pid=13025): stdout: | (launched: 2022-12-13_17:50:21.091503) 17:50:24.680204 run osmo-hlr_10.42.42.2(pid=13025): stderr: | [0;m[1;31m20221213175021289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175021289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175021290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175021290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175021290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175021290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175021302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175021313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175021313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175021313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:24.732844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Terminating (SIGTERM) 17:50:24.775681 run iperf3-srv_10.42.42.10(pid=13021): Terminating (SIGTERM) 17:50:24.818913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Terminating (SIGTERM) 17:50:24.861691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Terminating (SIGTERM) 17:50:24.904885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Terminating (SIGTERM) 17:50:24.947931 --- ParallelTerminationStrategy: PID 13020 died... 17:50:24.968741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Terminated: ok {rc=0} 17:50:25.016158 --- ParallelTerminationStrategy: PID 13021 died... 17:50:25.036376 run iperf3-srv_10.42.42.10(pid=13021): Terminated {rc=256} 17:50:25.083494 --- ParallelTerminationStrategy: PID 13024 died... 17:50:25.103404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Terminated: ok {rc=0} 17:50:25.151125 --- ParallelTerminationStrategy: PID 13027 died... 17:50:25.171035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Terminated: ok {rc=0} 17:50:25.218477 --- ParallelTerminationStrategy: PID 13030 died... 17:50:25.238649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Terminated: ok {rc=0} 17:50:25.329287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 17:50:26.479481 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:26.491307 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:26.541508 tst iperf3m4.py: using LAC 35248 17:50:26.665272 tst iperf3m4.py: using RAC 58 17:50:26.796570 tst iperf3m4.py: using CellId 35248 17:50:26.926355 tst iperf3m4.py: using BVCI 35249 17:50:27.041403 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.052131 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.062670 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.073075 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.083307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.094149 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.105132 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.116359 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.128015 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:27.250605 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:27.376903 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:27.497609 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:27.621229 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:27.847848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:28.182965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Launched 17:50:28.474908 run iperf3-srv_10.42.42.10(pid=13033): Launched 17:50:28.600447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:50:28.825998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:29.160494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Launched 17:50:29.451890 run iperf3-srv_10.42.42.10(pid=13035): Launched 17:50:29.578449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:50:29.803818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:30.138039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Launched 17:50:30.428602 run iperf3-srv_10.42.42.10(pid=13037): Launched 17:50:30.554529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:50:30.780119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:31.150666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Launched 17:50:31.456185 run iperf3-srv_10.42.42.10(pid=13039): Launched 17:50:31.596676 tst iperf3m4.py:8: start network... 17:50:31.826624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:32.349652 run create_hlr_db(pid=13040): Launched 17:50:32.476805 bus /gobi_6: Setting Powered False 17:50:33.542503 run create_hlr_db(pid=13040): Terminated: ok {rc=0} 17:50:34.005676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Launched 17:50:34.340137 run osmo-hlr_10.42.42.2(pid=13043): Launched 17:50:34.469790 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:35.046006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Launched 17:50:35.380821 run osmo-stp_10.42.42.5(pid=13046): Launched 17:50:35.507625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:36.081672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Launched 17:50:36.209726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:36.493786 run patchelf(pid=13049): Launched 17:50:36.681360 run osmo-stp_10.42.42.5(pid=13046): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] 17:50:36.823360 run osmo-stp_10.42.42.5(pid=13046): stdout: | (launched: 2022-12-13_17:50:35.319539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:36.966656 run osmo-stp_10.42.42.5(pid=13046): stderr: | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175035511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:37.110097 run osmo-stp_10.42.42.5(pid=13046): stdout: | (launched: 2022-12-13_17:50:35.319539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:37.246783 run osmo-stp_10.42.42.5(pid=13046): stderr: | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175035510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175035511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175035511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:37.409383 run patchelf(pid=13049): Terminating (SIGINT) 17:50:37.599615 run patchelf(pid=13049): Terminated: ok {rc=0} 17:50:37.737301 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13046): Process ended prematurely: osmo-stp_10.42.42.5(pid=13046) [trial-2392↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] [trial-2392↪gprs:trx-umtrx↪iperf3m4.py:8] 17:50:37.747833 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:50:37.777108 run osmo-hlr_10.42.42.2(pid=13043): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13043)] 17:50:37.828330 run osmo-hlr_10.42.42.2(pid=13043): stdout: | (launched: 2022-12-13_17:50:34.279098) 17:50:37.880924 run osmo-hlr_10.42.42.2(pid=13043): stderr: | [0;m[1;31m20221213175034476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175034476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175034476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175034477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175034477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175034477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175034492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175034502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175034502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175034502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:37.933834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Terminating (SIGTERM) 17:50:37.976290 run iperf3-srv_10.42.42.10(pid=13033): Terminating (SIGTERM) 17:50:38.019436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Terminating (SIGTERM) 17:50:38.062001 run iperf3-srv_10.42.42.10(pid=13035): Terminating (SIGTERM) 17:50:38.105070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminating (SIGTERM) 17:50:38.147516 run iperf3-srv_10.42.42.10(pid=13037): Terminating (SIGTERM) 17:50:38.190423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Terminating (SIGTERM) 17:50:38.233046 run iperf3-srv_10.42.42.10(pid=13039): Terminating (SIGTERM) 17:50:38.275821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Terminating (SIGTERM) 17:50:38.318470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Terminating (SIGTERM) 17:50:38.361383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Terminating (SIGTERM) 17:50:38.404725 --- ParallelTerminationStrategy: PID 13032 died... 17:50:38.425597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Terminated: ok {rc=0} 17:50:38.472857 --- ParallelTerminationStrategy: PID 13033 died... 17:50:38.493153 run iperf3-srv_10.42.42.10(pid=13033): Terminated {rc=256} 17:50:38.540090 --- ParallelTerminationStrategy: PID 13034 died... 17:50:38.560337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Terminated: ok {rc=0} 17:50:38.607559 --- ParallelTerminationStrategy: PID 13035 died... 17:50:38.627838 run iperf3-srv_10.42.42.10(pid=13035): Terminated {rc=256} 17:50:38.675191 --- ParallelTerminationStrategy: PID 13036 died... 17:50:38.695539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminated: ok {rc=0} 17:50:38.742670 --- ParallelTerminationStrategy: PID 13037 died... 17:50:38.762842 run iperf3-srv_10.42.42.10(pid=13037): Terminated {rc=256} 17:50:38.809906 --- ParallelTerminationStrategy: PID 13038 died... 17:50:38.830260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Terminated: ok {rc=0} 17:50:38.877425 --- ParallelTerminationStrategy: PID 13039 died... 17:50:38.897628 run iperf3-srv_10.42.42.10(pid=13039): Terminated {rc=256} 17:50:38.944526 --- ParallelTerminationStrategy: PID 13042 died... 17:50:38.964847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Terminated: ok {rc=0} 17:50:39.012309 --- ParallelTerminationStrategy: PID 13045 died... 17:50:39.032906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Terminated: ok {rc=0} 17:50:39.080256 --- ParallelTerminationStrategy: PID 13048 died... 17:50:39.100729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Terminated: ok {rc=0} 17:50:39.191186 bus /gobi_4: Setting Powered False 17:50:40.291526 bus /gobi_4: Setting Powered False 17:50:41.410433 bus /gobi_1: Setting Powered False 17:50:42.506719 bus /gobi_1: Setting Powered False 17:50:43.624792 bus /gobi_0: Setting Powered False 17:50:44.724488 bus /gobi_0: Setting Powered False 17:50:45.854463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx ping.py ---------------------------------------------- 17:50:46.964603 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:46.978744 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:47.038246 tst ping.py: using LAC 35249 17:50:47.193286 tst ping.py: using RAC 59 17:50:47.323389 tst ping.py: using CellId 35249 17:50:47.450960 tst ping.py: using BVCI 35250 17:50:47.571410 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.582584 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.593516 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.604369 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.615854 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.627102 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.638426 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:47.650020 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:47.771548 tst ping.py:19: start network... 17:50:47.993421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:48.498800 run create_hlr_db(pid=13050): Launched 17:50:48.623211 bus /gobi_6: Setting Powered False 17:50:49.688168 run create_hlr_db(pid=13050): Terminated: ok {rc=0} 17:50:50.124243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Launched 17:50:50.428405 run osmo-hlr_10.42.42.2(pid=13053): Launched 17:50:50.543362 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:51.068191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Launched 17:50:51.372860 run osmo-stp_10.42.42.5(pid=13056): Launched 17:50:51.488856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:52.033294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Launched 17:50:52.158334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:52.436184 run patchelf(pid=13062): Launched 17:50:52.619894 run osmo-stp_10.42.42.5(pid=13056): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] 17:50:52.759428 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-13_17:50:51.316350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:52.900421 run osmo-stp_10.42.42.5(pid=13056): stderr: | [0;m[38;5;43m20221213175051483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175051483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175051484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175051484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175051484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175051485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175051485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.041045 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-13_17:50:51.316350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:53.175467 run osmo-stp_10.42.42.5(pid=13056): stderr: | [0;m[38;5;43m20221213175051483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175051483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175051484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175051484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175051484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175051485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175051485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.335085 run patchelf(pid=13062): Terminating (SIGINT) 17:50:53.520328 run patchelf(pid=13062): Terminated: ok {rc=0} 17:50:53.654391 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2392↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] [trial-2392↪gprs:trx-umtrx↪ping.py:22] 17:50:53.664121 tst ping.py:22: Test FAILED (6.7 sec) 17:50:53.692792 run osmo-hlr_10.42.42.2(pid=13053): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13053)] 17:50:53.744500 run osmo-hlr_10.42.42.2(pid=13053): stdout: | (launched: 2022-12-13_17:50:50.372158) 17:50:53.797364 run osmo-hlr_10.42.42.2(pid=13053): stderr: | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175050547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175050559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175050568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175050568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175050568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:53.850464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminating (SIGTERM) 17:50:53.893430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminating (SIGTERM) 17:50:53.936580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Terminating (SIGTERM) 17:50:53.980290 --- ParallelTerminationStrategy: PID 13052 died... 17:50:54.003067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminated: ok {rc=0} 17:50:54.051556 --- ParallelTerminationStrategy: PID 13055 died... 17:50:54.071410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminated: ok {rc=0} 17:50:54.116620 --- ParallelTerminationStrategy: PID 13061 died... 17:50:54.136213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Terminated: ok {rc=0} 17:50:54.224819 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 17:50:55.315459 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.326798 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:55.381167 tst ping_idle_ping.py: using LAC 35250 17:50:55.500503 tst ping_idle_ping.py: using RAC 60 17:50:55.619605 tst ping_idle_ping.py: using CellId 35250 17:50:55.739195 tst ping_idle_ping.py: using BVCI 35251 17:50:55.850259 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.860850 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.871413 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.882140 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.892659 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.903240 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.913832 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:55.924261 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:56.041233 tst ping_idle_ping.py:24: start network... 17:50:56.246257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:56.721482 run create_hlr_db(pid=13063): Launched 17:50:56.846165 bus /gobi_6: Setting Powered False 17:50:57.907962 run create_hlr_db(pid=13063): Terminated: ok {rc=0} 17:50:58.336707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13065): Launched 17:50:58.642449 run osmo-hlr_10.42.42.2(pid=13066): Launched 17:50:58.757133 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:59.300123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13068): Launched 17:50:59.606400 run osmo-stp_10.42.42.5(pid=13069): Launched 17:50:59.721848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:00.251628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13071): Launched 17:51:00.368279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:00.627105 run patchelf(pid=13072): Launched 17:51:00.797048 run osmo-stp_10.42.42.5(pid=13069): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13069)] 17:51:00.932480 run osmo-stp_10.42.42.5(pid=13069): stdout: | (launched: 2022-12-13_17:50:59.549401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:01.066035 run osmo-stp_10.42.42.5(pid=13069): stderr: | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175059719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:01.199850 run osmo-stp_10.42.42.5(pid=13069): stdout: | (launched: 2022-12-13_17:50:59.549401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:01.327218 run osmo-stp_10.42.42.5(pid=13069): stderr: | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175059719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175059719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175059720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:01.478363 run patchelf(pid=13072): Terminating (SIGINT) 17:51:01.655177 run patchelf(pid=13072): Terminated: ok {rc=0} 17:51:01.782024 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13069): Process ended prematurely: osmo-stp_10.42.42.5(pid=13069) [trial-2392↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13069)] [trial-2392↪gprs:trx-umtrx↪ping_idle_ping.py:27] 17:51:01.791604 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:51:01.819413 run osmo-hlr_10.42.42.2(pid=13066): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13066)] 17:51:01.869238 run osmo-hlr_10.42.42.2(pid=13066): stdout: | (launched: 2022-12-13_17:50:58.585743) 17:51:01.921134 run osmo-hlr_10.42.42.2(pid=13066): stderr: | [0;m[1;31m20221213175058761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175058761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175058761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175058761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175058761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175058762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175058774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175058783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175058783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175058783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:01.973747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13065): Terminating (SIGTERM) 17:51:02.015984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13068): Terminating (SIGTERM) 17:51:02.059416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13071): Terminating (SIGTERM) 17:51:02.102406 --- ParallelTerminationStrategy: PID 13065 died... 17:51:02.122526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13065): Terminated: ok {rc=0} 17:51:02.169881 --- ParallelTerminationStrategy: PID 13068 died... 17:51:02.189511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13068): Terminated: ok {rc=0} 17:51:02.234962 --- ParallelTerminationStrategy: PID 13071 died... 17:51:02.254011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13071): Terminated: ok {rc=0} 17:51:02.339952 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 17:51:03.649375 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:03.655616 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:51:03.689213 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:51:03.731070 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:51:03.819334 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:51:03.852780 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:51:03.893575 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:51:04.489861 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:51:04.544814 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:04.556208 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:04.606847 tst cs_paging_gprs_active.py: using LAC 35251 17:51:04.728876 tst cs_paging_gprs_active.py: using RAC 61 17:51:04.850273 tst cs_paging_gprs_active.py: using CellId 35251 17:51:04.971362 tst cs_paging_gprs_active.py: using BVCI 35252 17:51:05.085816 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.096866 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.108049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.118948 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.129834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.140355 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.151926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.162877 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:05.174020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:05.297674 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:05.420852 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:51:05.647124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:05.984261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13076): Launched 17:51:06.277784 run iperf3-srv_10.42.42.10(pid=13077): Launched 17:51:06.403753 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:51:06.630939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:06.969617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13078): Launched 17:51:07.262632 run iperf3-srv_10.42.42.10(pid=13079): Launched 17:51:07.388090 tst cs_paging_gprs_active.py:38: start network... 17:51:07.614650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:08.133663 run create_hlr_db(pid=13080): Launched 17:51:08.263407 bus /gobi_6: Setting Powered False 17:51:09.328864 run create_hlr_db(pid=13080): Terminated: ok {rc=0} 17:51:09.775013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Launched 17:51:10.088233 run osmo-hlr_10.42.42.2(pid=13083): Launched 17:51:10.206686 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:10.750809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Launched 17:51:11.062266 run osmo-stp_10.42.42.5(pid=13086): Launched 17:51:11.180125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:11.715570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Launched 17:51:11.836160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:12.100392 run patchelf(pid=13089): Launched 17:51:12.274831 run osmo-stp_10.42.42.5(pid=13086): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] 17:51:12.406367 run osmo-stp_10.42.42.5(pid=13086): stdout: | (launched: 2022-12-13_17:51:11.004650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:12.539433 run osmo-stp_10.42.42.5(pid=13086): stderr: | [0;m[38;5;43m20221213175111174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175111175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175111175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175111175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:12.672253 run osmo-stp_10.42.42.5(pid=13086): stdout: | (launched: 2022-12-13_17:51:11.004650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:12.798873 run osmo-stp_10.42.42.5(pid=13086): stderr: | [0;m[38;5;43m20221213175111174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175111175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175111175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175111175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175111176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:12.948936 run patchelf(pid=13089): Terminating (SIGINT) 17:51:13.125516 run patchelf(pid=13089): Terminated: ok {rc=0} 17:51:13.252327 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13086): Process ended prematurely: osmo-stp_10.42.42.5(pid=13086) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:51:13.261976 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:51:13.289461 run osmo-hlr_10.42.42.2(pid=13083): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13083)] 17:51:13.337519 run osmo-hlr_10.42.42.2(pid=13083): stdout: | (launched: 2022-12-13_17:51:10.030637) 17:51:13.387281 run osmo-hlr_10.42.42.2(pid=13083): stderr: | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175110208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175110221 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175110230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175110230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175110230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:13.437537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13076): Terminating (SIGTERM) 17:51:13.479335 run iperf3-srv_10.42.42.10(pid=13077): Terminating (SIGTERM) 17:51:13.519745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13078): Terminating (SIGTERM) 17:51:13.560136 run iperf3-srv_10.42.42.10(pid=13079): Terminating (SIGTERM) 17:51:13.600447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Terminating (SIGTERM) 17:51:13.640871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Terminating (SIGTERM) 17:51:13.681199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Terminating (SIGTERM) 17:51:13.722390 --- ParallelTerminationStrategy: PID 13076 died... 17:51:13.742010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13076): Terminated: ok {rc=0} 17:51:13.786506 --- ParallelTerminationStrategy: PID 13077 died... 17:51:13.805571 run iperf3-srv_10.42.42.10(pid=13077): Terminated {rc=256} 17:51:13.849962 --- ParallelTerminationStrategy: PID 13078 died... 17:51:13.868899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13078): Terminated: ok {rc=0} 17:51:13.913160 --- ParallelTerminationStrategy: PID 13079 died... 17:51:13.931907 run iperf3-srv_10.42.42.10(pid=13079): Terminated {rc=256} 17:51:13.976098 --- ParallelTerminationStrategy: PID 13082 died... 17:51:13.995067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Terminated: ok {rc=0} 17:51:14.039680 --- ParallelTerminationStrategy: PID 13085 died... 17:51:14.058756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Terminated: ok {rc=0} 17:51:14.103028 --- ParallelTerminationStrategy: PID 13088 died... 17:51:14.121958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Terminated: ok {rc=0} 17:51:14.208163 bus /gobi_0: Setting Powered False 17:51:15.308686 bus /gobi_0: Setting Powered False 17:51:16.443937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:51:17.613538 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:17.625528 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:17.680302 tst iperf3.py: using LAC 35252 17:51:17.813097 tst iperf3.py: using RAC 62 17:51:17.943533 tst iperf3.py: using CellId 35252 17:51:18.074087 tst iperf3.py: using BVCI 35253 17:51:18.195867 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.207285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.218428 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.229735 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.241076 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.252380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.263986 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.275312 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:18.286930 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:18.408579 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:18.633407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:18.966591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Launched 17:51:19.256092 run iperf3-srv_10.42.42.10(pid=13091): Launched 17:51:19.380438 tst iperf3.py:8: start network... 17:51:19.604673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:20.086922 run create_hlr_db(pid=13092): Launched 17:51:20.213533 bus /gobi_6: Setting Powered False 17:51:21.278166 run create_hlr_db(pid=13092): Terminated: ok {rc=0} 17:51:21.720466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Launched 17:51:22.030793 run osmo-hlr_10.42.42.2(pid=13095): Launched 17:51:22.148498 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:22.704382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Launched 17:51:23.014888 run osmo-stp_10.42.42.5(pid=13098): Launched 17:51:23.134604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:23.667682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Launched 17:51:23.786823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:24.048515 run patchelf(pid=13101): Launched 17:51:24.222509 run osmo-stp_10.42.42.5(pid=13098): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] 17:51:24.353234 run osmo-stp_10.42.42.5(pid=13098): stdout: | (launched: 2022-12-13_17:51:22.957579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:24.485526 run osmo-stp_10.42.42.5(pid=13098): stderr: | [0;m[38;5;43m20221213175123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175123128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175123128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:24.617556 run osmo-stp_10.42.42.5(pid=13098): stdout: | (launched: 2022-12-13_17:51:22.957579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:24.743496 run osmo-stp_10.42.42.5(pid=13098): stderr: | [0;m[38;5;43m20221213175123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175123128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175123128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175123129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:24.892838 run patchelf(pid=13101): Terminating (SIGINT) 17:51:25.069211 run patchelf(pid=13101): Terminated: ok {rc=0} 17:51:25.195731 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13098): Process ended prematurely: osmo-stp_10.42.42.5(pid=13098) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 17:51:25.205283 tst iperf3.py:8: Test FAILED (7.6 sec) 17:51:25.232449 run osmo-hlr_10.42.42.2(pid=13095): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13095)] 17:51:25.280144 run osmo-hlr_10.42.42.2(pid=13095): stdout: | (launched: 2022-12-13_17:51:21.973489) 17:51:25.329901 run osmo-hlr_10.42.42.2(pid=13095): stderr: | [0;m[1;31m20221213175122148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175122149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175122149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175122149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175122149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175122149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175122161 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175122169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175122169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175122169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:25.380035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Terminating (SIGTERM) 17:51:25.419894 run iperf3-srv_10.42.42.10(pid=13091): Terminating (SIGTERM) 17:51:25.459521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Terminating (SIGTERM) 17:51:25.499209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Terminating (SIGTERM) 17:51:25.538528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Terminating (SIGTERM) 17:51:25.578658 --- ParallelTerminationStrategy: PID 13090 died... 17:51:25.598122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Terminated: ok {rc=0} 17:51:25.642647 --- ParallelTerminationStrategy: PID 13091 died... 17:51:25.661492 run iperf3-srv_10.42.42.10(pid=13091): Terminated {rc=256} 17:51:25.705825 --- ParallelTerminationStrategy: PID 13094 died... 17:51:25.724638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Terminated: ok {rc=0} 17:51:25.768402 --- ParallelTerminationStrategy: PID 13097 died... 17:51:25.787277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Terminated: ok {rc=0} 17:51:25.831552 --- ParallelTerminationStrategy: PID 13100 died... 17:51:25.850564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Terminated: ok {rc=0} 17:51:25.935642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:51:27.081346 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.092804 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:27.143478 tst iperf3m4.py: using LAC 35253 17:51:27.266965 tst iperf3m4.py: using RAC 63 17:51:27.393193 tst iperf3m4.py: using CellId 35253 17:51:27.514161 tst iperf3m4.py: using BVCI 35254 17:51:27.626493 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.637639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.648398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.659036 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.669690 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.680716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.692082 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.702744 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.714235 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:27.838344 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:27.962857 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:28.082919 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:28.205851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:28.430939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:28.766048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Launched 17:51:29.057240 run iperf3-srv_10.42.42.10(pid=13103): Launched 17:51:29.182629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:51:29.407978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:29.743593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Launched 17:51:30.035730 run iperf3-srv_10.42.42.10(pid=13105): Launched 17:51:30.162184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:51:30.387340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:30.722400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13106): Launched 17:51:31.018972 run iperf3-srv_10.42.42.10(pid=13107): Launched 17:51:31.165839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:51:31.395881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:31.737507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13108): Launched 17:51:32.042841 run iperf3-srv_10.42.42.10(pid=13109): Launched 17:51:32.183345 tst iperf3m4.py:8: start network... 17:51:32.409156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:32.925793 run create_hlr_db(pid=13110): Launched 17:51:33.054058 bus /gobi_6: Setting Powered False 17:51:34.119370 run create_hlr_db(pid=13110): Terminated: ok {rc=0} 17:51:34.583388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Launched 17:51:34.917075 run osmo-hlr_10.42.42.2(pid=13113): Launched 17:51:35.046035 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:35.622913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Launched 17:51:35.956858 run osmo-stp_10.42.42.5(pid=13116): Launched 17:51:36.085125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:36.658987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13118): Launched 17:51:36.787317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:37.070081 run patchelf(pid=13119): Launched 17:51:37.256223 run osmo-stp_10.42.42.5(pid=13116): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] 17:51:37.397950 run osmo-stp_10.42.42.5(pid=13116): stdout: | (launched: 2022-12-13_17:51:35.895570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:37.541349 run osmo-stp_10.42.42.5(pid=13116): stderr: | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175136086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:37.685581 run osmo-stp_10.42.42.5(pid=13116): stdout: | (launched: 2022-12-13_17:51:35.895570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:37.822527 run osmo-stp_10.42.42.5(pid=13116): stderr: | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175136085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175136086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175136086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:37.984229 run patchelf(pid=13119): Terminating (SIGINT) 17:51:38.173787 run patchelf(pid=13119): Terminated: ok {rc=0} 17:51:38.310068 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13116): Process ended prematurely: osmo-stp_10.42.42.5(pid=13116) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 17:51:38.320530 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:51:38.349955 run osmo-hlr_10.42.42.2(pid=13113): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13113)] 17:51:38.401587 run osmo-hlr_10.42.42.2(pid=13113): stdout: | (launched: 2022-12-13_17:51:34.855753) 17:51:38.454739 run osmo-hlr_10.42.42.2(pid=13113): stderr: | [0;m[1;31m20221213175135052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175135052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175135052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175135053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175135053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175135053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175135066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175135074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175135075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175135075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:38.508566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Terminating (SIGTERM) 17:51:38.551176 run iperf3-srv_10.42.42.10(pid=13103): Terminating (SIGTERM) 17:51:38.594132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Terminating (SIGTERM) 17:51:38.637093 run iperf3-srv_10.42.42.10(pid=13105): Terminating (SIGTERM) 17:51:38.680035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13106): Terminating (SIGTERM) 17:51:38.723215 run iperf3-srv_10.42.42.10(pid=13107): Terminating (SIGTERM) 17:51:38.766036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13108): Terminating (SIGTERM) 17:51:38.808807 run iperf3-srv_10.42.42.10(pid=13109): Terminating (SIGTERM) 17:51:38.851518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Terminating (SIGTERM) 17:51:38.894903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Terminating (SIGTERM) 17:51:38.937732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13118): Terminating (SIGTERM) 17:51:38.981091 --- ParallelTerminationStrategy: PID 13102 died... 17:51:39.002116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Terminated: ok {rc=0} 17:51:39.049734 --- ParallelTerminationStrategy: PID 13103 died... 17:51:39.070439 run iperf3-srv_10.42.42.10(pid=13103): Terminated {rc=256} 17:51:39.117422 --- ParallelTerminationStrategy: PID 13104 died... 17:51:39.137778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Terminated: ok {rc=0} 17:51:39.185171 --- ParallelTerminationStrategy: PID 13105 died... 17:51:39.205530 run iperf3-srv_10.42.42.10(pid=13105): Terminated {rc=256} 17:51:39.252784 --- ParallelTerminationStrategy: PID 13106 died... 17:51:39.273232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13106): Terminated: ok {rc=0} 17:51:39.321041 --- ParallelTerminationStrategy: PID 13107 died... 17:51:39.341337 run iperf3-srv_10.42.42.10(pid=13107): Terminated {rc=256} 17:51:39.388451 --- ParallelTerminationStrategy: PID 13108 died... 17:51:39.408816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13108): Terminated: ok {rc=0} 17:51:39.455987 --- ParallelTerminationStrategy: PID 13109 died... 17:51:39.476448 run iperf3-srv_10.42.42.10(pid=13109): Terminated {rc=256} 17:51:39.523619 --- ParallelTerminationStrategy: PID 13112 died... 17:51:39.543976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Terminated: ok {rc=0} 17:51:39.591319 --- ParallelTerminationStrategy: PID 13115 died... 17:51:39.611677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Terminated: ok {rc=0} 17:51:39.658896 --- ParallelTerminationStrategy: PID 13118 died... 17:51:39.679681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13118): Terminated: ok {rc=0} 17:51:39.768843 bus /gobi_4: Setting Powered False 17:51:40.869414 bus /gobi_4: Setting Powered False 17:51:41.987373 bus /gobi_1: Setting Powered False 17:51:43.088153 bus /gobi_1: Setting Powered False 17:51:44.205836 bus /gobi_0: Setting Powered False 17:51:45.305279 bus /gobi_0: Setting Powered False 17:51:46.434818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 17:51:47.548096 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:47.559665 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:47.609895 tst ping.py: using LAC 35254 17:51:47.739528 tst ping.py: using RAC 64 17:51:47.860341 tst ping.py: using CellId 35254 17:51:47.979764 tst ping.py: using BVCI 35255 17:51:48.091345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.102471 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.113549 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.124284 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.134842 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.145939 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.157249 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:48.167884 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:48.284719 tst ping.py:19: start network... 17:51:48.489776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:48.962011 run create_hlr_db(pid=13120): Launched 17:51:49.088905 bus /gobi_6: Setting Powered False 17:51:50.150831 run create_hlr_db(pid=13120): Terminated: ok {rc=0} 17:51:50.578843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Launched 17:51:50.884280 run osmo-hlr_10.42.42.2(pid=13123): Launched 17:51:50.999793 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:51.524679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Launched 17:51:51.828283 run osmo-stp_10.42.42.5(pid=13126): Launched 17:51:51.944850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:52.470039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Launched 17:51:52.586101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:52.846877 run patchelf(pid=13129): Launched 17:51:53.028236 run osmo-stp_10.42.42.5(pid=13126): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] 17:51:53.167115 run osmo-stp_10.42.42.5(pid=13126): stdout: | (launched: 2022-12-13_17:51:51.772040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:53.307646 run osmo-stp_10.42.42.5(pid=13126): stderr: | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175151943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:53.448432 run osmo-stp_10.42.42.5(pid=13126): stdout: | (launched: 2022-12-13_17:51:51.772040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:53.582361 run osmo-stp_10.42.42.5(pid=13126): stderr: | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175151943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175151943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175151944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:53.741814 run patchelf(pid=13129): Terminating (SIGINT) 17:51:53.925838 run patchelf(pid=13129): Terminated: ok {rc=0} 17:51:54.058716 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13126): Process ended prematurely: osmo-stp_10.42.42.5(pid=13126) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 17:51:54.068273 tst ping.py:22: Test FAILED (6.5 sec) 17:51:54.096739 run osmo-hlr_10.42.42.2(pid=13123): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13123)] 17:51:54.148403 run osmo-hlr_10.42.42.2(pid=13123): stdout: | (launched: 2022-12-13_17:51:50.827500) 17:51:54.201918 run osmo-hlr_10.42.42.2(pid=13123): stderr: | [0;m[1;31m20221213175150999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175150999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175150999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175151000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175151000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175151000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175151015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175151026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175151026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175151026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:54.255062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Terminating (SIGTERM) 17:51:54.298035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Terminating (SIGTERM) 17:51:54.341156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Terminating (SIGTERM) 17:51:54.384891 --- ParallelTerminationStrategy: PID 13122 died... 17:51:54.405982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Terminated: ok {rc=0} 17:51:54.453842 --- ParallelTerminationStrategy: PID 13125 died... 17:51:54.474350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Terminated: ok {rc=0} 17:51:54.521640 --- ParallelTerminationStrategy: PID 13128 died... 17:51:54.542181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Terminated: ok {rc=0} 17:51:54.632061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:51:55.719839 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:55.732261 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:55.785588 tst ping_idle_ping.py: using LAC 35255 17:51:55.906649 tst ping_idle_ping.py: using RAC 65 17:51:56.027609 tst ping_idle_ping.py: using CellId 35255 17:51:56.148289 tst ping_idle_ping.py: using BVCI 35256 17:51:56.269941 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.281496 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.292754 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.304166 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.316192 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.328305 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.340653 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:56.352838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:56.476810 tst ping_idle_ping.py:24: start network... 17:51:56.700324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:57.210343 run create_hlr_db(pid=13130): Launched 17:51:57.336532 bus /gobi_6: Setting Powered False 17:51:58.402087 run create_hlr_db(pid=13130): Terminated: ok {rc=0} 17:51:58.860576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13132): Launched 17:51:59.191516 run osmo-hlr_10.42.42.2(pid=13133): Launched 17:51:59.317287 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:59.887654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13135): Launched 17:52:00.217984 run osmo-stp_10.42.42.5(pid=13136): Launched 17:52:00.343536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:00.929769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13138): Launched 17:52:01.069632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:01.353608 run patchelf(pid=13139): Launched 17:52:01.543120 run osmo-stp_10.42.42.5(pid=13136): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13136)] 17:52:01.680799 run osmo-stp_10.42.42.5(pid=13136): stdout: | (launched: 2022-12-13_17:52:00.157261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:01.817290 run osmo-stp_10.42.42.5(pid=13136): stderr: | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175200348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:01.953107 run osmo-stp_10.42.42.5(pid=13136): stdout: | (launched: 2022-12-13_17:52:00.157261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:02.083337 run osmo-stp_10.42.42.5(pid=13136): stderr: | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175200347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175200348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175200348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:02.236341 run patchelf(pid=13139): Terminating (SIGINT) 17:52:02.411940 run patchelf(pid=13139): Terminated: ok {rc=0} 17:52:02.538119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13136): Process ended prematurely: osmo-stp_10.42.42.5(pid=13136) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13136)] [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 17:52:02.547348 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:52:02.574617 run osmo-hlr_10.42.42.2(pid=13133): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13133)] 17:52:02.624123 run osmo-hlr_10.42.42.2(pid=13133): stdout: | (launched: 2022-12-13_17:51:59.130564) 17:52:02.675141 run osmo-hlr_10.42.42.2(pid=13133): stderr: | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175159327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175159341 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175159351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175159351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175159351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:02.726432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13132): Terminating (SIGTERM) 17:52:02.767301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13135): Terminating (SIGTERM) 17:52:02.808439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13138): Terminating (SIGTERM) 17:52:02.850130 --- ParallelTerminationStrategy: PID 13132 died... 17:52:02.870396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13132): Terminated: ok {rc=0} 17:52:02.915912 --- ParallelTerminationStrategy: PID 13135 died... 17:52:02.935532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13135): Terminated: ok {rc=0} 17:52:02.980849 --- ParallelTerminationStrategy: PID 13138 died... 17:52:03.001087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13138): Terminated: ok {rc=0} 17:52:03.089197 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:52:04.391213 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:04.397196 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:52:04.429587 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:52:04.467943 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:52:04.558358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:52:04.591307 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:52:04.629542 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:52:05.218706 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:52:05.268634 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.279540 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:05.346207 tst cs_paging_gprs_active.py: using LAC 35256 17:52:05.468414 tst cs_paging_gprs_active.py: using RAC 66 17:52:05.588524 tst cs_paging_gprs_active.py: using CellId 35256 17:52:05.708473 tst cs_paging_gprs_active.py: using BVCI 35257 17:52:05.821299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.832080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.842868 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.853556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.864068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.875204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.885975 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.896882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:05.908077 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:06.032882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:06.156159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:52:06.382899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:06.719679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13145): Launched 17:52:07.012366 run iperf3-srv_10.42.42.10(pid=13146): Launched 17:52:07.139262 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:52:07.364845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:07.701624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13147): Launched 17:52:07.994947 run iperf3-srv_10.42.42.10(pid=13148): Launched 17:52:08.121103 tst cs_paging_gprs_active.py:38: start network... 17:52:08.346675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:08.864746 run create_hlr_db(pid=13149): Launched 17:52:08.994674 bus /gobi_6: Setting Powered False 17:52:10.056265 run create_hlr_db(pid=13149): Terminated: ok {rc=0} 17:52:10.512770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13151): Launched 17:52:10.849149 run osmo-hlr_10.42.42.2(pid=13152): Launched 17:52:10.978365 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:11.555373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13154): Launched 17:52:11.890998 run osmo-stp_10.42.42.5(pid=13155): Launched 17:52:12.019014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:12.595170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13157): Launched 17:52:12.725726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:13.016495 run patchelf(pid=13158): Launched 17:52:13.202426 run osmo-stp_10.42.42.5(pid=13155): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13155)] 17:52:13.344543 run osmo-stp_10.42.42.5(pid=13155): stdout: | (launched: 2022-12-13_17:52:11.829484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:13.487892 run osmo-stp_10.42.42.5(pid=13155): stderr: | [0;m[38;5;43m20221213175212021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175212022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175212022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175212022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:13.631272 run osmo-stp_10.42.42.5(pid=13155): stdout: | (launched: 2022-12-13_17:52:11.829484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:13.768594 run osmo-stp_10.42.42.5(pid=13155): stderr: | [0;m[38;5;43m20221213175212021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175212022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175212022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175212022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175212023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:13.930856 run patchelf(pid=13158): Terminating (SIGINT) 17:52:14.119588 run patchelf(pid=13158): Terminated: ok {rc=0} 17:52:14.255588 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13155): Process ended prematurely: osmo-stp_10.42.42.5(pid=13155) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13155)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:52:14.265980 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:52:14.294986 run osmo-hlr_10.42.42.2(pid=13152): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13152)] 17:52:14.346584 run osmo-hlr_10.42.42.2(pid=13152): stdout: | (launched: 2022-12-13_17:52:10.787344) 17:52:14.399624 run osmo-hlr_10.42.42.2(pid=13152): stderr: | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175210985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175210997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175211005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175211006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175211006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:14.453562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13145): Terminating (SIGTERM) 17:52:14.496070 run iperf3-srv_10.42.42.10(pid=13146): Terminating (SIGTERM) 17:52:14.539027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13147): Terminating (SIGTERM) 17:52:14.582158 run iperf3-srv_10.42.42.10(pid=13148): Terminating (SIGTERM) 17:52:14.624789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13151): Terminating (SIGTERM) 17:52:14.667637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13154): Terminating (SIGTERM) 17:52:14.711132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13157): Terminating (SIGTERM) 17:52:14.754264 --- ParallelTerminationStrategy: PID 13145 died... 17:52:14.775175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13145): Terminated: ok {rc=0} 17:52:14.822649 --- ParallelTerminationStrategy: PID 13146 died... 17:52:14.843035 run iperf3-srv_10.42.42.10(pid=13146): Terminated {rc=256} 17:52:14.890179 --- ParallelTerminationStrategy: PID 13147 died... 17:52:14.910672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13147): Terminated: ok {rc=0} 17:52:14.957782 --- ParallelTerminationStrategy: PID 13148 died... 17:52:14.978073 run iperf3-srv_10.42.42.10(pid=13148): Terminated {rc=256} 17:52:15.025283 --- ParallelTerminationStrategy: PID 13151 died... 17:52:15.045558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13151): Terminated: ok {rc=0} 17:52:15.092874 --- ParallelTerminationStrategy: PID 13154 died... 17:52:15.113907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13154): Terminated: ok {rc=0} 17:52:15.161198 --- ParallelTerminationStrategy: PID 13157 died... 17:52:15.181717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13157): Terminated: ok {rc=0} 17:52:15.271407 bus /gobi_0: Setting Powered False 17:52:16.368677 bus /gobi_0: Setting Powered False 17:52:17.485573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:52:18.638141 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:18.650258 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:18.721782 tst iperf3.py: using LAC 35257 17:52:18.853289 tst iperf3.py: using RAC 67 17:52:18.984712 tst iperf3.py: using CellId 35257 17:52:19.114749 tst iperf3.py: using BVCI 35258 17:52:19.238217 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.249712 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.260708 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.271942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.283314 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.294793 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.306462 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.317803 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:19.329368 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:19.455414 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:19.681113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:20.017522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Launched 17:52:20.309719 run iperf3-srv_10.42.42.10(pid=13160): Launched 17:52:20.435540 tst iperf3.py:8: start network... 17:52:20.661272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:21.179183 run create_hlr_db(pid=13161): Launched 17:52:21.307186 bus /gobi_6: Setting Powered False 17:52:22.372354 run create_hlr_db(pid=13161): Terminated: ok {rc=0} 17:52:22.816240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13163): Launched 17:52:23.127628 run osmo-hlr_10.42.42.2(pid=13164): Launched 17:52:23.247412 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:23.889584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13166): Launched 17:52:24.195595 run osmo-stp_10.42.42.5(pid=13167): Launched 17:52:24.311355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:24.840732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13169): Launched 17:52:24.958211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:25.220455 run patchelf(pid=13170): Launched 17:52:25.390759 run osmo-stp_10.42.42.5(pid=13167): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13167)] 17:52:25.520504 run osmo-stp_10.42.42.5(pid=13167): stdout: | (launched: 2022-12-13_17:52:24.139161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:25.651697 run osmo-stp_10.42.42.5(pid=13167): stderr: | [0;m[38;5;43m20221213175224306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175224306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175224307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175224307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:25.782957 run osmo-stp_10.42.42.5(pid=13167): stdout: | (launched: 2022-12-13_17:52:24.139161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:25.907479 run osmo-stp_10.42.42.5(pid=13167): stderr: | [0;m[38;5;43m20221213175224306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175224306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175224307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175224307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175224308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:26.055280 run patchelf(pid=13170): Terminating (SIGINT) 17:52:26.229551 run patchelf(pid=13170): Terminated: ok {rc=0} 17:52:26.354576 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13167): Process ended prematurely: osmo-stp_10.42.42.5(pid=13167) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13167)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 17:52:26.364057 tst iperf3.py:8: Test FAILED (7.8 sec) 17:52:26.391464 run osmo-hlr_10.42.42.2(pid=13164): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13164)] 17:52:26.439617 run osmo-hlr_10.42.42.2(pid=13164): stdout: | (launched: 2022-12-13_17:52:23.070001) 17:52:26.489365 run osmo-hlr_10.42.42.2(pid=13164): stderr: | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175223246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175223270 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175223280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175223280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175223280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:26.539443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Terminating (SIGTERM) 17:52:26.579453 run iperf3-srv_10.42.42.10(pid=13160): Terminating (SIGTERM) 17:52:26.619858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13163): Terminating (SIGTERM) 17:52:26.660080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13166): Terminating (SIGTERM) 17:52:26.700112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13169): Terminating (SIGTERM) 17:52:26.740449 --- ParallelTerminationStrategy: PID 13159 died... 17:52:26.759789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Terminated: ok {rc=0} 17:52:26.804214 --- ParallelTerminationStrategy: PID 13160 died... 17:52:26.823078 run iperf3-srv_10.42.42.10(pid=13160): Terminated {rc=256} 17:52:26.867359 --- ParallelTerminationStrategy: PID 13163 died... 17:52:26.886301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13163): Terminated: ok {rc=0} 17:52:26.930627 --- ParallelTerminationStrategy: PID 13166 died... 17:52:26.949497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13166): Terminated: ok {rc=0} 17:52:26.993690 --- ParallelTerminationStrategy: PID 13169 died... 17:52:27.012430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13169): Terminated: ok {rc=0} 17:52:27.099748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:52:28.248617 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.263318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:28.330447 tst iperf3m4.py: using LAC 35258 17:52:28.450411 tst iperf3m4.py: using RAC 68 17:52:28.580042 tst iperf3m4.py: using CellId 35258 17:52:28.708588 tst iperf3m4.py: using BVCI 35259 17:52:28.829563 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.841061 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.852333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.863667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.875397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.886974 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.898665 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.910245 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.921950 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:29.040255 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:29.164039 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:29.287755 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:29.407697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:29.612678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:29.919849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Launched 17:52:30.188288 run iperf3-srv_10.42.42.10(pid=13172): Launched 17:52:30.303026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:52:30.506926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:30.815073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Launched 17:52:31.163226 run iperf3-srv_10.42.42.10(pid=13174): Launched 17:52:31.323145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:52:31.539216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:31.860065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13175): Launched 17:52:32.144835 run iperf3-srv_10.42.42.10(pid=13176): Launched 17:52:32.275787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:52:32.479700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:32.788171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13177): Launched 17:52:33.054800 run iperf3-srv_10.42.42.10(pid=13178): Launched 17:52:33.170377 tst iperf3m4.py:8: start network... 17:52:33.374026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:33.848534 run create_hlr_db(pid=13179): Launched 17:52:33.973135 bus /gobi_6: Setting Powered False 17:52:35.033971 run create_hlr_db(pid=13179): Terminated: ok {rc=0} 17:52:35.461076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13181): Launched 17:52:35.766240 run osmo-hlr_10.42.42.2(pid=13182): Launched 17:52:35.880711 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:36.422003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13184): Launched 17:52:36.727031 run osmo-stp_10.42.42.5(pid=13185): Launched 17:52:36.841511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:37.367753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13187): Launched 17:52:37.485210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:37.744366 run patchelf(pid=13188): Launched 17:52:37.914804 run osmo-stp_10.42.42.5(pid=13185): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13185)] 17:52:38.043890 run osmo-stp_10.42.42.5(pid=13185): stdout: | (launched: 2022-12-13_17:52:36.669730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:38.174259 run osmo-stp_10.42.42.5(pid=13185): stderr: | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175236838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:38.304709 run osmo-stp_10.42.42.5(pid=13185): stdout: | (launched: 2022-12-13_17:52:36.669730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:38.428736 run osmo-stp_10.42.42.5(pid=13185): stderr: | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175236838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175236838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175236839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:38.575865 run patchelf(pid=13188): Terminating (SIGINT) 17:52:38.749827 run patchelf(pid=13188): Terminated: ok {rc=0} 17:52:38.874234 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13185): Process ended prematurely: osmo-stp_10.42.42.5(pid=13185) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13185)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:52:38.883685 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:52:38.911014 run osmo-hlr_10.42.42.2(pid=13182): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13182)] 17:52:38.959182 run osmo-hlr_10.42.42.2(pid=13182): stdout: | (launched: 2022-12-13_17:52:35.709610) 17:52:39.009672 run osmo-hlr_10.42.42.2(pid=13182): stderr: | [0;m[1;31m20221213175235885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175235885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175235885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175235886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175235886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175235886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175235898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175235907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175235907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175235907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:39.060076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Terminating (SIGTERM) 17:52:39.100049 run iperf3-srv_10.42.42.10(pid=13172): Terminating (SIGTERM) 17:52:39.140047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Terminating (SIGTERM) 17:52:39.179955 run iperf3-srv_10.42.42.10(pid=13174): Terminating (SIGTERM) 17:52:39.219824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13175): Terminating (SIGTERM) 17:52:39.259842 run iperf3-srv_10.42.42.10(pid=13176): Terminating (SIGTERM) 17:52:39.299745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13177): Terminating (SIGTERM) 17:52:39.339739 run iperf3-srv_10.42.42.10(pid=13178): Terminating (SIGTERM) 17:52:39.379624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13181): Terminating (SIGTERM) 17:52:39.419657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13184): Terminating (SIGTERM) 17:52:39.459680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13187): Terminating (SIGTERM) 17:52:39.499748 --- ParallelTerminationStrategy: PID 13171 died... 17:52:39.519091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Terminated: ok {rc=0} 17:52:39.563683 --- ParallelTerminationStrategy: PID 13172 died... 17:52:39.582490 run iperf3-srv_10.42.42.10(pid=13172): Terminated {rc=256} 17:52:39.626543 --- ParallelTerminationStrategy: PID 13173 died... 17:52:39.645226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Terminated: ok {rc=0} 17:52:39.689317 --- ParallelTerminationStrategy: PID 13174 died... 17:52:39.708008 run iperf3-srv_10.42.42.10(pid=13174): Terminated {rc=256} 17:52:39.752020 --- ParallelTerminationStrategy: PID 13175 died... 17:52:39.770704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13175): Terminated: ok {rc=0} 17:52:39.814903 --- ParallelTerminationStrategy: PID 13176 died... 17:52:39.834175 run iperf3-srv_10.42.42.10(pid=13176): Terminated {rc=256} 17:52:39.878172 --- ParallelTerminationStrategy: PID 13177 died... 17:52:39.896916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13177): Terminated: ok {rc=0} 17:52:39.941284 --- ParallelTerminationStrategy: PID 13178 died... 17:52:39.960031 run iperf3-srv_10.42.42.10(pid=13178): Terminated {rc=256} 17:52:40.004139 --- ParallelTerminationStrategy: PID 13181 died... 17:52:40.022839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13181): Terminated: ok {rc=0} 17:52:40.067027 --- ParallelTerminationStrategy: PID 13184 died... 17:52:40.085783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13184): Terminated: ok {rc=0} 17:52:40.129874 --- ParallelTerminationStrategy: PID 13187 died... 17:52:40.148509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13187): Terminated: ok {rc=0} 17:52:40.235503 bus /gobi_4: Setting Powered False 17:52:41.336383 bus /gobi_4: Setting Powered False 17:52:42.451945 bus /gobi_1: Setting Powered False 17:52:43.551432 bus /gobi_1: Setting Powered False 17:52:44.668609 bus /gobi_0: Setting Powered False 17:52:45.768859 bus /gobi_0: Setting Powered False 17:52:46.907309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:52:48.022316 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.033827 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:48.102583 tst ping.py: using LAC 35259 17:52:48.222232 tst ping.py: using RAC 69 17:52:48.345332 tst ping.py: using CellId 35259 17:52:48.462876 tst ping.py: using BVCI 35260 17:52:48.572674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.583695 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.594405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.605013 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.615606 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.626783 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.637927 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:48.648845 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:48.770469 tst ping.py:19: start network... 17:52:48.989600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:49.489685 run create_hlr_db(pid=13189): Launched 17:52:49.614624 bus /gobi_6: Setting Powered False 17:52:50.678616 run create_hlr_db(pid=13189): Terminated: ok {rc=0} 17:52:51.111051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13191): Launched 17:52:51.414790 run osmo-hlr_10.42.42.2(pid=13192): Launched 17:52:51.529058 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:52.048709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13194): Launched 17:52:52.349543 run osmo-stp_10.42.42.5(pid=13195): Launched 17:52:52.464685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:52.987334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13197): Launched 17:52:53.102054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:53.356285 run patchelf(pid=13198): Launched 17:52:53.523575 run osmo-stp_10.42.42.5(pid=13195): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13195)] 17:52:53.651491 run osmo-stp_10.42.42.5(pid=13195): stdout: | (launched: 2022-12-13_17:52:52.293252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:53.781842 run osmo-stp_10.42.42.5(pid=13195): stderr: | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175252462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:53.911925 run osmo-stp_10.42.42.5(pid=13195): stdout: | (launched: 2022-12-13_17:52:52.293252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:54.035355 run osmo-stp_10.42.42.5(pid=13195): stderr: | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175252461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175252462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175252462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:54.181748 run patchelf(pid=13198): Terminating (SIGINT) 17:52:54.352382 run patchelf(pid=13198): Terminated: ok {rc=0} 17:52:54.475602 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13195): Process ended prematurely: osmo-stp_10.42.42.5(pid=13195) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13195)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 17:52:54.484620 tst ping.py:22: Test FAILED (6.5 sec) 17:52:54.511472 run osmo-hlr_10.42.42.2(pid=13192): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13192)] 17:52:54.559598 run osmo-hlr_10.42.42.2(pid=13192): stdout: | (launched: 2022-12-13_17:52:51.358453) 17:52:54.609922 run osmo-hlr_10.42.42.2(pid=13192): stderr: | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175251530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175251543 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175251551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175251552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175251552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:54.660894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13191): Terminating (SIGTERM) 17:52:54.701445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13194): Terminating (SIGTERM) 17:52:54.741767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13197): Terminating (SIGTERM) 17:52:54.782496 --- ParallelTerminationStrategy: PID 13191 died... 17:52:54.801996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13191): Terminated: ok {rc=0} 17:52:54.847281 --- ParallelTerminationStrategy: PID 13194 died... 17:52:54.866189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13194): Terminated: ok {rc=0} 17:52:54.910721 --- ParallelTerminationStrategy: PID 13197 died... 17:52:54.929616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13197): Terminated: ok {rc=0} 17:52:55.015100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:52:56.103544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.115882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:56.190854 tst ping_idle_ping.py: using LAC 35260 17:52:56.319301 tst ping_idle_ping.py: using RAC 70 17:52:56.449409 tst ping_idle_ping.py: using CellId 35260 17:52:56.575034 tst ping_idle_ping.py: using BVCI 35261 17:52:56.694009 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.705881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.717124 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.728351 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.740029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.751552 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.763309 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:56.774875 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:56.896813 tst ping_idle_ping.py:24: start network... 17:52:57.114833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:57.612614 run create_hlr_db(pid=13199): Launched 17:52:57.735501 bus /gobi_6: Setting Powered False 17:52:58.799449 run create_hlr_db(pid=13199): Terminated: ok {rc=0} 17:52:59.249622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Launched 17:52:59.574303 run osmo-hlr_10.42.42.2(pid=13202): Launched 17:52:59.698890 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:00.252577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Launched 17:53:00.578199 run osmo-stp_10.42.42.5(pid=13205): Launched 17:53:00.700074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:01.266558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Launched 17:53:01.398457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:01.669119 run patchelf(pid=13208): Launched 17:53:01.857112 run osmo-stp_10.42.42.5(pid=13205): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] 17:53:01.989993 run osmo-stp_10.42.42.5(pid=13205): stdout: | (launched: 2022-12-13_17:53:00.518528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:02.125186 run osmo-stp_10.42.42.5(pid=13205): stderr: | [0;m[38;5;43m20221213175300710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175300710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175300711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175300711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175300711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175300712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175300712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:02.257566 run osmo-stp_10.42.42.5(pid=13205): stdout: | (launched: 2022-12-13_17:53:00.518528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:02.381995 run osmo-stp_10.42.42.5(pid=13205): stderr: | [0;m[38;5;43m20221213175300710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175300710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175300711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175300711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175300711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175300712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175300712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:02.529521 run patchelf(pid=13208): Terminating (SIGINT) 17:53:02.702137 run patchelf(pid=13208): Terminated: ok {rc=0} 17:53:02.826550 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13205): Process ended prematurely: osmo-stp_10.42.42.5(pid=13205) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:53:02.835725 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:53:02.862821 run osmo-hlr_10.42.42.2(pid=13202): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13202)] 17:53:02.911978 run osmo-hlr_10.42.42.2(pid=13202): stdout: | (launched: 2022-12-13_17:52:59.514719) 17:53:02.962630 run osmo-hlr_10.42.42.2(pid=13202): stderr: | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175259710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175259723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175259731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175259731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175259731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:03.013333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Terminating (SIGTERM) 17:53:03.053862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Terminating (SIGTERM) 17:53:03.094785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Terminating (SIGTERM) 17:53:03.135841 --- ParallelTerminationStrategy: PID 13201 died... 17:53:03.155462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Terminated: ok {rc=0} 17:53:03.200514 --- ParallelTerminationStrategy: PID 13204 died... 17:53:03.220019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Terminated: ok {rc=0} 17:53:03.264876 --- ParallelTerminationStrategy: PID 13207 died... 17:53:03.284922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Terminated: ok {rc=0} 17:53:03.371505 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:53:04.673413 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:53:04.679331 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:53:04.711453 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:53:04.749798 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:53:04.836233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:53:04.868598 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:53:04.907123 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:53:05.499999 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:53:05.549418 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:05.560241 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:05.629823 tst cs_paging_gprs_active.py: using LAC 35261 17:53:05.759950 tst cs_paging_gprs_active.py: using RAC 71 17:53:05.888787 tst cs_paging_gprs_active.py: using CellId 35261 17:53:06.019002 tst cs_paging_gprs_active.py: using BVCI 35262 17:53:06.140778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.152480 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.163924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.175443 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.187284 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.199257 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.211264 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.223139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:06.235258 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:06.356333 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:06.483541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:53:06.706971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:07.039731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13212): Launched 17:53:07.327476 run iperf3-srv_10.42.42.10(pid=13213): Launched 17:53:07.453153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:53:07.675049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:08.007478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13214): Launched 17:53:08.294308 run iperf3-srv_10.42.42.10(pid=13215): Launched 17:53:08.419019 tst cs_paging_gprs_active.py:38: start network... 17:53:08.640566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:09.150826 run create_hlr_db(pid=13216): Launched 17:53:09.275755 bus /gobi_6: Setting Powered False 17:53:10.341132 run create_hlr_db(pid=13216): Terminated: ok {rc=0} 17:53:10.782630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Launched 17:53:11.092373 run osmo-hlr_10.42.42.2(pid=13219): Launched 17:53:11.210617 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:11.740885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Launched 17:53:12.048605 run osmo-stp_10.42.42.5(pid=13222): Launched 17:53:12.164843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:12.693979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Launched 17:53:12.814191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:13.076239 run patchelf(pid=13225): Launched 17:53:13.247316 run osmo-stp_10.42.42.5(pid=13222): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] 17:53:13.377411 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_17:53:11.991967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:13.509281 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175312161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175312161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175312161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175312162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:13.640912 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_17:53:11.991967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:13.766436 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175312160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175312161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175312161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175312161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175312162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:13.915232 run patchelf(pid=13225): Terminating (SIGINT) 17:53:14.089660 run patchelf(pid=13225): Terminated: ok {rc=0} 17:53:14.215279 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:53:14.224747 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:53:14.251966 run osmo-hlr_10.42.42.2(pid=13219): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13219)] 17:53:14.300114 run osmo-hlr_10.42.42.2(pid=13219): stdout: | (launched: 2022-12-13_17:53:11.035579) 17:53:14.350257 run osmo-hlr_10.42.42.2(pid=13219): stderr: | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175311213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175311225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175311236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175311236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175311236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:14.400567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13212): Terminating (SIGTERM) 17:53:14.440354 run iperf3-srv_10.42.42.10(pid=13213): Terminating (SIGTERM) 17:53:14.480037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13214): Terminating (SIGTERM) 17:53:14.519849 run iperf3-srv_10.42.42.10(pid=13215): Terminating (SIGTERM) 17:53:14.559683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminating (SIGTERM) 17:53:14.599730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminating (SIGTERM) 17:53:14.639606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminating (SIGTERM) 17:53:14.679883 --- ParallelTerminationStrategy: PID 13212 died... 17:53:14.699102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13212): Terminated: ok {rc=0} 17:53:14.743328 --- ParallelTerminationStrategy: PID 13213 died... 17:53:14.761928 run iperf3-srv_10.42.42.10(pid=13213): Terminated {rc=256} 17:53:14.806278 --- ParallelTerminationStrategy: PID 13214 died... 17:53:14.825123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13214): Terminated: ok {rc=0} 17:53:14.869333 --- ParallelTerminationStrategy: PID 13215 died... 17:53:14.887937 run iperf3-srv_10.42.42.10(pid=13215): Terminated {rc=256} 17:53:14.931852 --- ParallelTerminationStrategy: PID 13218 died... 17:53:14.950508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminated: ok {rc=0} 17:53:14.994989 --- ParallelTerminationStrategy: PID 13221 died... 17:53:15.014172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminated: ok {rc=0} 17:53:15.058365 --- ParallelTerminationStrategy: PID 13224 died... 17:53:15.077196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminated: ok {rc=0} 17:53:15.162121 bus /gobi_0: Setting Powered False 17:53:16.271203 bus /gobi_0: Setting Powered False 17:53:17.400521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:53:18.552202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:18.564457 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:18.637378 tst iperf3.py: using LAC 35262 17:53:18.766529 tst iperf3.py: using RAC 72 17:53:18.896846 tst iperf3.py: using CellId 35262 17:53:19.024245 tst iperf3.py: using BVCI 35263 17:53:19.143906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.155575 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.166947 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.178339 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.190185 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.202066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.213799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.225100 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:19.236843 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:19.358697 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:53:19.579689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:19.908883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13226): Launched 17:53:20.195743 run iperf3-srv_10.42.42.10(pid=13227): Launched 17:53:20.318418 tst iperf3.py:8: start network... 17:53:20.538928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:21.044437 run create_hlr_db(pid=13228): Launched 17:53:21.169431 bus /gobi_6: Setting Powered False 17:53:22.233828 run create_hlr_db(pid=13228): Terminated: ok {rc=0} 17:53:22.672111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13230): Launched 17:53:22.978076 run osmo-hlr_10.42.42.2(pid=13231): Launched 17:53:23.094897 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:23.623580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13233): Launched 17:53:23.931003 run osmo-stp_10.42.42.5(pid=13234): Launched 17:53:24.047586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:24.577239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13236): Launched 17:53:24.694598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:24.954353 run patchelf(pid=13237): Launched 17:53:25.127551 run osmo-stp_10.42.42.5(pid=13234): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13234)] 17:53:25.257302 run osmo-stp_10.42.42.5(pid=13234): stdout: | (launched: 2022-12-13_17:53:23.874114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:25.388689 run osmo-stp_10.42.42.5(pid=13234): stderr: | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175324043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:25.519964 run osmo-stp_10.42.42.5(pid=13234): stdout: | (launched: 2022-12-13_17:53:23.874114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:25.645083 run osmo-stp_10.42.42.5(pid=13234): stderr: | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175324042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175324043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175324043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:25.793475 run patchelf(pid=13237): Terminating (SIGINT) 17:53:25.968440 run patchelf(pid=13237): Terminated: ok {rc=0} 17:53:26.094389 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13234): Process ended prematurely: osmo-stp_10.42.42.5(pid=13234) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13234)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 17:53:26.103935 tst iperf3.py:8: Test FAILED (7.6 sec) 17:53:26.131136 run osmo-hlr_10.42.42.2(pid=13231): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13231)] 17:53:26.179213 run osmo-hlr_10.42.42.2(pid=13231): stdout: | (launched: 2022-12-13_17:53:22.921588) 17:53:26.229390 run osmo-hlr_10.42.42.2(pid=13231): stderr: | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175323095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175323107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175323117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175323118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175323118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:26.280042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13226): Terminating (SIGTERM) 17:53:26.319968 run iperf3-srv_10.42.42.10(pid=13227): Terminating (SIGTERM) 17:53:26.359926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13230): Terminating (SIGTERM) 17:53:26.399861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13233): Terminating (SIGTERM) 17:53:26.439967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13236): Terminating (SIGTERM) 17:53:26.480156 --- ParallelTerminationStrategy: PID 13226 died... 17:53:26.499672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13226): Terminated: ok {rc=0} 17:53:26.544162 --- ParallelTerminationStrategy: PID 13227 died... 17:53:26.563060 run iperf3-srv_10.42.42.10(pid=13227): Terminated {rc=256} 17:53:26.608048 --- ParallelTerminationStrategy: PID 13230 died... 17:53:26.626987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13230): Terminated: ok {rc=0} 17:53:26.671338 --- ParallelTerminationStrategy: PID 13233 died... 17:53:26.690313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13233): Terminated: ok {rc=0} 17:53:26.734759 --- ParallelTerminationStrategy: PID 13236 died... 17:53:26.753768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13236): Terminated: ok {rc=0} 17:53:26.837978 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:53:27.985350 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:27.997065 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:28.068092 tst iperf3m4.py: using LAC 35263 17:53:28.189725 tst iperf3m4.py: using RAC 73 17:53:28.310433 tst iperf3m4.py: using CellId 35263 17:53:28.432859 tst iperf3m4.py: using BVCI 35264 17:53:28.544156 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.555126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.565849 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.576507 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.587273 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.598763 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.609789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.620637 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:28.631753 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:28.750054 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:28.874109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:28.992172 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:29.114042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:53:29.335723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:29.665525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Launched 17:53:29.952514 run iperf3-srv_10.42.42.10(pid=13239): Launched 17:53:30.075250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:53:30.296669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:30.626079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Launched 17:53:30.937347 run iperf3-srv_10.42.42.10(pid=13241): Launched 17:53:31.090381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:53:31.316528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:31.657751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Launched 17:53:31.937886 run iperf3-srv_10.42.42.10(pid=13243): Launched 17:53:32.077629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:53:32.304348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:32.636380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13244): Launched 17:53:32.924660 run iperf3-srv_10.42.42.10(pid=13245): Launched 17:53:33.049384 tst iperf3m4.py:8: start network... 17:53:33.270716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:33.777488 run create_hlr_db(pid=13246): Launched 17:53:33.903881 bus /gobi_6: Setting Powered False 17:53:34.964669 run create_hlr_db(pid=13246): Terminated: ok {rc=0} 17:53:35.426111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13248): Launched 17:53:35.757096 run osmo-hlr_10.42.42.2(pid=13249): Launched 17:53:35.883788 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:36.450197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13251): Launched 17:53:36.778277 run osmo-stp_10.42.42.5(pid=13252): Launched 17:53:36.907071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:37.474786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13254): Launched 17:53:37.597627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:37.858204 run patchelf(pid=13255): Launched 17:53:38.029588 run osmo-stp_10.42.42.5(pid=13252): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13252)] 17:53:38.160358 run osmo-stp_10.42.42.5(pid=13252): stdout: | (launched: 2022-12-13_17:53:36.717618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:38.292033 run osmo-stp_10.42.42.5(pid=13252): stderr: | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175336909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175336909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175336910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175336910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:38.423657 run osmo-stp_10.42.42.5(pid=13252): stdout: | (launched: 2022-12-13_17:53:36.717618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:38.548714 run osmo-stp_10.42.42.5(pid=13252): stderr: | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175336908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175336909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175336909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175336910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175336910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:38.696864 run patchelf(pid=13255): Terminating (SIGINT) 17:53:38.871520 run patchelf(pid=13255): Terminated: ok {rc=0} 17:53:38.996736 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13252): Process ended prematurely: osmo-stp_10.42.42.5(pid=13252) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13252)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:53:39.006320 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:53:39.034024 run osmo-hlr_10.42.42.2(pid=13249): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13249)] 17:53:39.082202 run osmo-hlr_10.42.42.2(pid=13249): stdout: | (launched: 2022-12-13_17:53:35.696123) 17:53:39.132306 run osmo-hlr_10.42.42.2(pid=13249): stderr: | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175335894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175335906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175335915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175335915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175335915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:39.183164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Terminating (SIGTERM) 17:53:39.223606 run iperf3-srv_10.42.42.10(pid=13239): Terminating (SIGTERM) 17:53:39.263681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Terminating (SIGTERM) 17:53:39.303705 run iperf3-srv_10.42.42.10(pid=13241): Terminating (SIGTERM) 17:53:39.345168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Terminating (SIGTERM) 17:53:39.385669 run iperf3-srv_10.42.42.10(pid=13243): Terminating (SIGTERM) 17:53:39.425665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13244): Terminating (SIGTERM) 17:53:39.465506 run iperf3-srv_10.42.42.10(pid=13245): Terminating (SIGTERM) 17:53:39.505356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13248): Terminating (SIGTERM) 17:53:39.545425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13251): Terminating (SIGTERM) 17:53:39.585340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13254): Terminating (SIGTERM) 17:53:39.625672 --- ParallelTerminationStrategy: PID 13238 died... 17:53:39.645120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Terminated: ok {rc=0} 17:53:39.689763 --- ParallelTerminationStrategy: PID 13239 died... 17:53:39.708486 run iperf3-srv_10.42.42.10(pid=13239): Terminated {rc=256} 17:53:39.752782 --- ParallelTerminationStrategy: PID 13240 died... 17:53:39.771610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Terminated: ok {rc=0} 17:53:39.815873 --- ParallelTerminationStrategy: PID 13241 died... 17:53:39.835060 run iperf3-srv_10.42.42.10(pid=13241): Terminated {rc=256} 17:53:39.879058 --- ParallelTerminationStrategy: PID 13242 died... 17:53:39.897958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Terminated: ok {rc=0} 17:53:39.942002 --- ParallelTerminationStrategy: PID 13243 died... 17:53:39.960882 run iperf3-srv_10.42.42.10(pid=13243): Terminated {rc=256} 17:53:40.004935 --- ParallelTerminationStrategy: PID 13244 died... 17:53:40.023889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13244): Terminated: ok {rc=0} 17:53:40.068134 --- ParallelTerminationStrategy: PID 13245 died... 17:53:40.087028 run iperf3-srv_10.42.42.10(pid=13245): Terminated {rc=256} 17:53:40.131244 --- ParallelTerminationStrategy: PID 13248 died... 17:53:40.150176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13248): Terminated: ok {rc=0} 17:53:40.194170 --- ParallelTerminationStrategy: PID 13251 died... 17:53:40.213047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13251): Terminated: ok {rc=0} 17:53:40.257070 --- ParallelTerminationStrategy: PID 13254 died... 17:53:40.276021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13254): Terminated: ok {rc=0} 17:53:40.363230 bus /gobi_4: Setting Powered False 17:53:41.463077 bus /gobi_4: Setting Powered False 17:53:42.578899 bus /gobi_1: Setting Powered False 17:53:43.678834 bus /gobi_1: Setting Powered False 17:53:44.795450 bus /gobi_0: Setting Powered False 17:53:45.916212 bus /gobi_0: Setting Powered False 17:53:47.047045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:53:48.162874 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.175478 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:48.250517 tst ping.py: using LAC 35264 17:53:48.369526 tst ping.py: using RAC 74 17:53:48.490474 tst ping.py: using CellId 35264 17:53:48.608715 tst ping.py: using BVCI 35265 17:53:48.721428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.733326 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.744928 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.756628 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.768314 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.779956 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.791772 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:48.803414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:48.924678 tst ping.py:19: start network... 17:53:49.131908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:49.614606 run create_hlr_db(pid=13267): Launched 17:53:49.775769 bus /gobi_6: Setting Powered False 17:53:50.837898 run create_hlr_db(pid=13267): Terminated: ok {rc=0} 17:53:51.272583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Launched 17:53:51.593099 run osmo-hlr_10.42.42.2(pid=13272): Launched 17:53:51.828468 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:52.567753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13300): Launched 17:53:52.931278 run osmo-stp_10.42.42.5(pid=13319): Launched 17:53:53.204770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:53.906578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Launched 17:53:54.061908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:54.377791 run patchelf(pid=13489): Launched 17:53:54.603016 run osmo-stp_10.42.42.5(pid=13319): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13319)] 17:53:54.757246 run osmo-stp_10.42.42.5(pid=13319): stdout: | (launched: 2022-12-13_17:53:52.864293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:54.901287 run osmo-stp_10.42.42.5(pid=13319): stderr: | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175353209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:55.039301 run osmo-stp_10.42.42.5(pid=13319): stdout: | (launched: 2022-12-13_17:53:52.864293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:55.166612 run osmo-stp_10.42.42.5(pid=13319): stderr: | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175353209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175353209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175353210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:55.320339 run patchelf(pid=13489): Terminating (SIGINT) 17:53:55.498254 run patchelf(pid=13489): Terminated: ok {rc=0} 17:53:55.627090 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13319): Process ended prematurely: osmo-stp_10.42.42.5(pid=13319) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13319)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 17:53:55.637135 tst ping.py:22: Test FAILED (7.5 sec) 17:53:55.665964 run osmo-hlr_10.42.42.2(pid=13272): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13272)] 17:53:55.716453 run osmo-hlr_10.42.42.2(pid=13272): stdout: | (launched: 2022-12-13_17:53:51.536398) 17:53:55.768539 run osmo-hlr_10.42.42.2(pid=13272): stderr: | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175351865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175351891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175351907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175351908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175351908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:55.822105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Terminating (SIGTERM) 17:53:55.864288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13300): Terminating (SIGTERM) 17:53:55.908346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Terminating (SIGTERM) 17:53:55.953441 --- ParallelTerminationStrategy: PID 13271 died... 17:53:55.973746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Terminated: ok {rc=0} 17:53:56.022668 --- ParallelTerminationStrategy: PID 13300 died... 17:53:56.042986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13300): Terminated: ok {rc=0} 17:53:56.089253 --- ParallelTerminationStrategy: PID 13425 died... 17:53:56.109305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Terminated: ok {rc=0} 17:53:56.198314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:53:57.292521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.305524 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:57.381074 tst ping_idle_ping.py: using LAC 35265 17:53:57.505511 tst ping_idle_ping.py: using RAC 75 17:53:57.628027 tst ping_idle_ping.py: using CellId 35265 17:53:57.750837 tst ping_idle_ping.py: using BVCI 35266 17:53:57.864904 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.876755 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.888675 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.900505 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.912657 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.924449 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.936365 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:57.948110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:58.069079 tst ping_idle_ping.py:24: start network... 17:53:58.281776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:58.772434 run create_hlr_db(pid=13539): Launched 17:53:58.931621 bus /gobi_6: Setting Powered False 17:53:59.998022 run create_hlr_db(pid=13539): Terminated: ok {rc=0} 17:54:00.470959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13541): Launched 17:54:00.820311 run osmo-hlr_10.42.42.2(pid=13542): Launched 17:54:01.070932 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:01.739912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13544): Launched 17:54:02.087147 run osmo-stp_10.42.42.5(pid=13545): Launched 17:54:02.334421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:02.991484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13547): Launched 17:54:03.124332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:03.413732 run patchelf(pid=13548): Launched 17:54:03.616168 run osmo-stp_10.42.42.5(pid=13545): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13545)] 17:54:03.761497 run osmo-stp_10.42.42.5(pid=13545): stdout: | (launched: 2022-12-13_17:54:02.026756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:03.907741 run osmo-stp_10.42.42.5(pid=13545): stderr: | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175402318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:04.053969 run osmo-stp_10.42.42.5(pid=13545): stdout: | (launched: 2022-12-13_17:54:02.026756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:04.191835 run osmo-stp_10.42.42.5(pid=13545): stderr: | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175402317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175402318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175402318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:04.358955 run patchelf(pid=13548): Terminating (SIGINT) 17:54:04.550872 run patchelf(pid=13548): Terminated: ok {rc=0} 17:54:04.691003 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13545): Process ended prematurely: osmo-stp_10.42.42.5(pid=13545) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13545)] [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:54:04.701919 tst ping_idle_ping.py:27: Test FAILED (7.4 sec) 17:54:04.733102 run osmo-hlr_10.42.42.2(pid=13542): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13542)] 17:54:04.789848 run osmo-hlr_10.42.42.2(pid=13542): stdout: | (launched: 2022-12-13_17:54:00.759393) 17:54:04.847045 run osmo-hlr_10.42.42.2(pid=13542): stderr: | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175401063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175401083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175401096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175401096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175401096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:04.903919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13541): Terminating (SIGTERM) 17:54:04.949283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13544): Terminating (SIGTERM) 17:54:04.997187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13547): Terminating (SIGTERM) 17:54:05.046210 --- ParallelTerminationStrategy: PID 13541 died... 17:54:05.069086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13541): Terminated: ok {rc=0} 17:54:05.121352 --- ParallelTerminationStrategy: PID 13544 died... 17:54:05.142767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13544): Terminated: ok {rc=0} 17:54:05.193174 --- ParallelTerminationStrategy: PID 13547 died... 17:54:05.215578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13547): Terminated: ok {rc=0} 17:54:05.313875 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:54:06.636863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:06.646781 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:54:06.684325 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:54:06.729286 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:54:06.819682 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:54:06.855474 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:54:06.898140 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:54:07.502646 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:54:07.556186 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:07.568797 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:07.625412 tst cs_paging_gprs_active.py: using LAC 35266 17:54:07.749117 tst cs_paging_gprs_active.py: using RAC 76 17:54:07.874084 tst cs_paging_gprs_active.py: using CellId 35266 17:54:07.996315 tst cs_paging_gprs_active.py: using BVCI 35267 17:54:08.113702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.126091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.138297 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.150654 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.162976 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.175333 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.187959 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.200209 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:08.212645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:08.338437 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:08.462462 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:54:08.678047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:09.000842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13553): Launched 17:54:09.296728 run iperf3-srv_10.42.42.10(pid=13554): Launched 17:54:09.432534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:54:09.647932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:09.975417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13555): Launched 17:54:10.269962 run iperf3-srv_10.42.42.10(pid=13556): Launched 17:54:10.405240 tst cs_paging_gprs_active.py:38: start network... 17:54:10.620218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:11.120153 run create_hlr_db(pid=13557): Launched 17:54:11.287088 bus /gobi_6: Setting Powered False 17:54:12.348164 run create_hlr_db(pid=13557): Terminated: ok {rc=0} 17:54:12.786844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13559): Launched 17:54:13.098844 run osmo-hlr_10.42.42.2(pid=13560): Launched 17:54:13.215725 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:13.748178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13562): Launched 17:54:14.058243 run osmo-stp_10.42.42.5(pid=13563): Launched 17:54:14.175670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:14.710117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13565): Launched 17:54:14.830448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:15.092045 run patchelf(pid=13566): Launched 17:54:15.263966 run osmo-stp_10.42.42.5(pid=13563): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13563)] 17:54:15.395074 run osmo-stp_10.42.42.5(pid=13563): stdout: | (launched: 2022-12-13_17:54:14.000655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:15.528598 run osmo-stp_10.42.42.5(pid=13563): stderr: | [0;m[38;5;43m20221213175414170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175414170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175414171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175414171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175414171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175414172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175414172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:15.661452 run osmo-stp_10.42.42.5(pid=13563): stdout: | (launched: 2022-12-13_17:54:14.000655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:15.787577 run osmo-stp_10.42.42.5(pid=13563): stderr: | [0;m[38;5;43m20221213175414170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175414170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175414171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175414171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175414171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175414172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175414172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:15.946595 run patchelf(pid=13566): Terminating (SIGINT) 17:54:16.148283 run patchelf(pid=13566): Terminated: ok {rc=0} 17:54:16.313688 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13563): Process ended prematurely: osmo-stp_10.42.42.5(pid=13563) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13563)] [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:54:16.325158 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:54:16.356096 run osmo-hlr_10.42.42.2(pid=13560): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13560)] 17:54:16.412835 run osmo-hlr_10.42.42.2(pid=13560): stdout: | (launched: 2022-12-13_17:54:13.040568) 17:54:16.469714 run osmo-hlr_10.42.42.2(pid=13560): stderr: | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175413219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175413235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175413246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175413246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175413246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:16.526623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13553): Terminating (SIGTERM) 17:54:16.571246 run iperf3-srv_10.42.42.10(pid=13554): Terminating (SIGTERM) 17:54:16.617309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13555): Terminating (SIGTERM) 17:54:16.664540 run iperf3-srv_10.42.42.10(pid=13556): Terminating (SIGTERM) 17:54:16.710261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13559): Terminating (SIGTERM) 17:54:16.756586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13562): Terminating (SIGTERM) 17:54:16.804169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13565): Terminating (SIGTERM) 17:54:16.852696 --- ParallelTerminationStrategy: PID 13553 died... 17:54:16.875431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13553): Terminated: ok {rc=0} 17:54:16.927744 --- ParallelTerminationStrategy: PID 13554 died... 17:54:16.949066 run iperf3-srv_10.42.42.10(pid=13554): Terminated {rc=256} 17:54:16.998565 --- ParallelTerminationStrategy: PID 13555 died... 17:54:17.021131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13555): Terminated: ok {rc=0} 17:54:17.071584 --- ParallelTerminationStrategy: PID 13556 died... 17:54:17.093555 run iperf3-srv_10.42.42.10(pid=13556): Terminated {rc=256} 17:54:17.143099 --- ParallelTerminationStrategy: PID 13559 died... 17:54:17.165176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13559): Terminated: ok {rc=0} 17:54:17.215119 --- ParallelTerminationStrategy: PID 13562 died... 17:54:17.238009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13562): Terminated: ok {rc=0} 17:54:17.287937 --- ParallelTerminationStrategy: PID 13565 died... 17:54:17.309063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13565): Terminated: ok {rc=0} 17:54:17.400359 bus /gobi_0: Setting Powered False 17:54:18.498207 bus /gobi_0: Setting Powered False 17:54:19.614903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:54:20.764911 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:20.776884 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:20.831654 tst iperf3.py: using LAC 35267 17:54:20.962776 tst iperf3.py: using RAC 77 17:54:21.093775 tst iperf3.py: using CellId 35267 17:54:21.223459 tst iperf3.py: using BVCI 35268 17:54:21.337522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.349220 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.360165 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.371426 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.382684 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.394016 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.405265 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.416205 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:21.427435 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:21.549266 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:54:21.774020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:22.106877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13567): Launched 17:54:22.397535 run iperf3-srv_10.42.42.10(pid=13568): Launched 17:54:22.522451 tst iperf3.py:8: start network... 17:54:22.747191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:23.262197 run create_hlr_db(pid=13569): Launched 17:54:23.389520 bus /gobi_6: Setting Powered False 17:54:24.454720 run create_hlr_db(pid=13569): Terminated: ok {rc=0} 17:54:24.898194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Launched 17:54:25.209247 run osmo-hlr_10.42.42.2(pid=13572): Launched 17:54:25.327488 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:25.862635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Launched 17:54:26.173195 run osmo-stp_10.42.42.5(pid=13575): Launched 17:54:26.290342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:26.826253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13577): Launched 17:54:26.944830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:27.207122 run patchelf(pid=13578): Launched 17:54:27.379450 run osmo-stp_10.42.42.5(pid=13575): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] 17:54:27.511043 run osmo-stp_10.42.42.5(pid=13575): stdout: | (launched: 2022-12-13_17:54:26.114988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:27.644539 run osmo-stp_10.42.42.5(pid=13575): stderr: | [0;m[38;5;43m20221213175426289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175426289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175426290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175426290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:27.777444 run osmo-stp_10.42.42.5(pid=13575): stdout: | (launched: 2022-12-13_17:54:26.114988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:27.903907 run osmo-stp_10.42.42.5(pid=13575): stderr: | [0;m[38;5;43m20221213175426289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175426289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175426290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175426290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175426291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:28.054428 run patchelf(pid=13578): Terminating (SIGINT) 17:54:28.230718 run patchelf(pid=13578): Terminated: ok {rc=0} 17:54:28.357490 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13575): Process ended prematurely: osmo-stp_10.42.42.5(pid=13575) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:54:28.367022 tst iperf3.py:8: Test FAILED (7.6 sec) 17:54:28.394439 run osmo-hlr_10.42.42.2(pid=13572): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13572)] 17:54:28.442441 run osmo-hlr_10.42.42.2(pid=13572): stdout: | (launched: 2022-12-13_17:54:25.150946) 17:54:28.492199 run osmo-hlr_10.42.42.2(pid=13572): stderr: | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175425330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175425355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175425364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175425364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175425364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:28.542590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13567): Terminating (SIGTERM) 17:54:28.583184 run iperf3-srv_10.42.42.10(pid=13568): Terminating (SIGTERM) 17:54:28.623518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Terminating (SIGTERM) 17:54:28.663880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Terminating (SIGTERM) 17:54:28.704352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13577): Terminating (SIGTERM) 17:54:28.745202 --- ParallelTerminationStrategy: PID 13567 died... 17:54:28.764497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13567): Terminated: ok {rc=0} 17:54:28.809440 --- ParallelTerminationStrategy: PID 13568 died... 17:54:28.828228 run iperf3-srv_10.42.42.10(pid=13568): Terminated {rc=256} 17:54:28.872807 --- ParallelTerminationStrategy: PID 13571 died... 17:54:28.892374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Terminated: ok {rc=0} 17:54:28.936853 --- ParallelTerminationStrategy: PID 13574 died... 17:54:28.956327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Terminated: ok {rc=0} 17:54:29.001378 --- ParallelTerminationStrategy: PID 13577 died... 17:54:29.020468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13577): Terminated: ok {rc=0} 17:54:29.107083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:54:30.256112 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.268321 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:30.321103 tst iperf3m4.py: using LAC 35268 17:54:30.443903 tst iperf3m4.py: using RAC 78 17:54:30.565110 tst iperf3m4.py: using CellId 35268 17:54:30.688209 tst iperf3m4.py: using BVCI 35269 17:54:30.801587 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.812799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.823929 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.849872 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.867262 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.886924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.901526 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.915273 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.928226 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:31.082893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:31.212154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:31.344015 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:31.483285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:54:31.749145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:32.153705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13579): Launched 17:54:32.453676 run iperf3-srv_10.42.42.10(pid=13580): Launched 17:54:32.578962 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:54:32.804224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:33.138735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13581): Launched 17:54:33.427771 run iperf3-srv_10.42.42.10(pid=13582): Launched 17:54:33.553555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:54:33.778098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:34.111932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13583): Launched 17:54:34.402691 run iperf3-srv_10.42.42.10(pid=13584): Launched 17:54:34.528814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:54:34.752094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:35.085554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Launched 17:54:35.375401 run iperf3-srv_10.42.42.10(pid=13586): Launched 17:54:35.500824 tst iperf3m4.py:8: start network... 17:54:35.724909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:36.239577 run create_hlr_db(pid=13587): Launched 17:54:36.367643 bus /gobi_6: Setting Powered False 17:54:37.432717 run create_hlr_db(pid=13587): Terminated: ok {rc=0} 17:54:37.878191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Launched 17:54:38.190504 run osmo-hlr_10.42.42.2(pid=13590): Launched 17:54:38.310138 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:38.861655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Launched 17:54:39.174667 run osmo-stp_10.42.42.5(pid=13593): Launched 17:54:39.294718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:39.832477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Launched 17:54:39.951453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:40.214606 run patchelf(pid=13596): Launched 17:54:40.389351 run osmo-stp_10.42.42.5(pid=13593): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] 17:54:40.520472 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-13_17:54:39.116253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:40.653209 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221213175439285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175439286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175439286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175439286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:40.785813 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-13_17:54:39.116253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:40.911751 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221213175439285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175439286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175439286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175439286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175439287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:41.061569 run patchelf(pid=13596): Terminating (SIGINT) 17:54:41.238228 run patchelf(pid=13596): Terminated: ok {rc=0} 17:54:41.365349 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:54:41.374843 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:54:41.402561 run osmo-hlr_10.42.42.2(pid=13590): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13590)] 17:54:41.450989 run osmo-hlr_10.42.42.2(pid=13590): stdout: | (launched: 2022-12-13_17:54:38.132500) 17:54:41.501221 run osmo-hlr_10.42.42.2(pid=13590): stderr: | [0;m[1;31m20221213175438311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175438311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175438311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175438311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175438311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175438312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175438324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175438332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175438332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175438332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:41.551847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13579): Terminating (SIGTERM) 17:54:41.592531 run iperf3-srv_10.42.42.10(pid=13580): Terminating (SIGTERM) 17:54:41.632880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13581): Terminating (SIGTERM) 17:54:41.673115 run iperf3-srv_10.42.42.10(pid=13582): Terminating (SIGTERM) 17:54:41.713650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13583): Terminating (SIGTERM) 17:54:41.753993 run iperf3-srv_10.42.42.10(pid=13584): Terminating (SIGTERM) 17:54:41.793926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Terminating (SIGTERM) 17:54:41.833920 run iperf3-srv_10.42.42.10(pid=13586): Terminating (SIGTERM) 17:54:41.873750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminating (SIGTERM) 17:54:41.913912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminating (SIGTERM) 17:54:41.954053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Terminating (SIGTERM) 17:54:41.994317 --- ParallelTerminationStrategy: PID 13579 died... 17:54:42.013957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13579): Terminated: ok {rc=0} 17:54:42.058667 --- ParallelTerminationStrategy: PID 13580 died... 17:54:42.077558 run iperf3-srv_10.42.42.10(pid=13580): Terminated {rc=256} 17:54:42.121782 --- ParallelTerminationStrategy: PID 13581 died... 17:54:42.140622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13581): Terminated: ok {rc=0} 17:54:42.184885 --- ParallelTerminationStrategy: PID 13582 died... 17:54:42.204061 run iperf3-srv_10.42.42.10(pid=13582): Terminated {rc=256} 17:54:42.248369 --- ParallelTerminationStrategy: PID 13583 died... 17:54:42.267355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13583): Terminated: ok {rc=0} 17:54:42.311667 --- ParallelTerminationStrategy: PID 13584 died... 17:54:42.330305 run iperf3-srv_10.42.42.10(pid=13584): Terminated {rc=256} 17:54:42.374537 --- ParallelTerminationStrategy: PID 13585 died... 17:54:42.393268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Terminated: ok {rc=0} 17:54:42.437649 --- ParallelTerminationStrategy: PID 13586 died... 17:54:42.456408 run iperf3-srv_10.42.42.10(pid=13586): Terminated {rc=256} 17:54:42.500414 --- ParallelTerminationStrategy: PID 13589 died... 17:54:42.519699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminated: ok {rc=0} 17:54:42.563964 --- ParallelTerminationStrategy: PID 13592 died... 17:54:42.582940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminated: ok {rc=0} 17:54:42.627482 --- ParallelTerminationStrategy: PID 13595 died... 17:54:42.646504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Terminated: ok {rc=0} 17:54:42.733127 bus /gobi_4: Setting Powered False 17:54:43.834313 bus /gobi_4: Setting Powered False 17:54:44.949537 bus /gobi_1: Setting Powered False 17:54:46.046089 bus /gobi_1: Setting Powered False 17:54:47.164843 bus /gobi_0: Setting Powered False 17:54:48.267801 bus /gobi_0: Setting Powered False 17:54:49.387199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:54:50.491904 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:50.504393 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:50.568274 tst ping.py: using LAC 35269 17:54:50.695949 tst ping.py: using RAC 79 17:54:50.822285 tst ping.py: using CellId 35269 17:54:50.948463 tst ping.py: using BVCI 35270 17:54:51.060368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.072078 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.083372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.094822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.106252 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.117878 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.129500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:51.140696 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:51.258442 tst ping.py:19: start network... 17:54:51.462682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:51.933306 run create_hlr_db(pid=13597): Launched 17:54:52.056552 bus /gobi_6: Setting Powered False 17:54:53.117492 run create_hlr_db(pid=13597): Terminated: ok {rc=0} 17:54:53.563505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Launched 17:54:53.890785 run osmo-hlr_10.42.42.2(pid=13600): Launched 17:54:54.016379 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:54.579422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Launched 17:54:54.907814 run osmo-stp_10.42.42.5(pid=13603): Launched 17:54:55.032804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:55.595635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Launched 17:54:55.720373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:55.998192 run patchelf(pid=13606): Launched 17:54:56.179499 run osmo-stp_10.42.42.5(pid=13603): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] 17:54:56.318169 run osmo-stp_10.42.42.5(pid=13603): stdout: | (launched: 2022-12-13_17:54:54.847815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:56.459175 run osmo-stp_10.42.42.5(pid=13603): stderr: | [0;m[38;5;43m20221213175455039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175455039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175455040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175455040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175455040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:56.599929 run osmo-stp_10.42.42.5(pid=13603): stdout: | (launched: 2022-12-13_17:54:54.847815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:56.733980 run osmo-stp_10.42.42.5(pid=13603): stderr: | [0;m[38;5;43m20221213175455039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175455039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175455040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175455040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175455040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:56.893283 run patchelf(pid=13606): Terminating (SIGINT) 17:54:57.078091 run patchelf(pid=13606): Terminated: ok {rc=0} 17:54:57.210742 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13603): Process ended prematurely: osmo-stp_10.42.42.5(pid=13603) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:54:57.220435 tst ping.py:22: Test FAILED (6.7 sec) 17:54:57.248892 run osmo-hlr_10.42.42.2(pid=13600): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13600)] 17:54:57.300201 run osmo-hlr_10.42.42.2(pid=13600): stdout: | (launched: 2022-12-13_17:54:53.830994) 17:54:57.353805 run osmo-hlr_10.42.42.2(pid=13600): stderr: | [0;m[1;31m20221213175454028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175454028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175454028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175454028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175454028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175454029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175454042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175454050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175454050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175454050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:57.407427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Terminating (SIGTERM) 17:54:57.450207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Terminating (SIGTERM) 17:54:57.493888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Terminating (SIGTERM) 17:54:57.537283 --- ParallelTerminationStrategy: PID 13599 died... 17:54:57.558097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Terminated: ok {rc=0} 17:54:57.605593 --- ParallelTerminationStrategy: PID 13602 died... 17:54:57.625830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Terminated: ok {rc=0} 17:54:57.672905 --- ParallelTerminationStrategy: PID 13605 died... 17:54:57.693197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Terminated: ok {rc=0} 17:54:57.783246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:54:58.872079 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:58.884517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:58.940317 tst ping_idle_ping.py: using LAC 35270 17:54:59.069365 tst ping_idle_ping.py: using RAC 80 17:54:59.196486 tst ping_idle_ping.py: using CellId 35270 17:54:59.326114 tst ping_idle_ping.py: using BVCI 35271 17:54:59.446282 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.458268 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.469929 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.481617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.493613 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.505557 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.517630 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:59.529595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:59.652352 tst ping_idle_ping.py:24: start network... 17:54:59.873490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:00.380829 run create_hlr_db(pid=13608): Launched 17:55:00.506902 bus /gobi_6: Setting Powered False 17:55:01.584255 run create_hlr_db(pid=13608): Terminated: ok {rc=0} 17:55:02.100907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13613): Launched 17:55:02.439530 run osmo-hlr_10.42.42.2(pid=13614): Launched 17:55:02.565335 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:03.129392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13616): Launched 17:55:03.457967 run osmo-stp_10.42.42.5(pid=13617): Launched 17:55:03.583456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:04.150275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13619): Launched 17:55:04.276317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:04.553612 run patchelf(pid=13620): Launched 17:55:04.735689 run osmo-stp_10.42.42.5(pid=13617): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13617)] 17:55:04.875071 run osmo-stp_10.42.42.5(pid=13617): stdout: | (launched: 2022-12-13_17:55:03.397514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:05.016031 run osmo-stp_10.42.42.5(pid=13617): stderr: | [0;m[38;5;43m20221213175503590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175503590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175503591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175503591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175503591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175503591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175503592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:05.156885 run osmo-stp_10.42.42.5(pid=13617): stdout: | (launched: 2022-12-13_17:55:03.397514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:05.290992 run osmo-stp_10.42.42.5(pid=13617): stderr: | [0;m[38;5;43m20221213175503590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175503590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175503591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175503591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175503591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175503591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175503592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:05.450079 run patchelf(pid=13620): Terminating (SIGINT) 17:55:05.635801 run patchelf(pid=13620): Terminated: ok {rc=0} 17:55:05.769271 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13617): Process ended prematurely: osmo-stp_10.42.42.5(pid=13617) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13617)] [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:55:05.779039 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 17:55:05.807485 run osmo-hlr_10.42.42.2(pid=13614): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13614)] 17:55:05.859201 run osmo-hlr_10.42.42.2(pid=13614): stdout: | (launched: 2022-12-13_17:55:02.378952) 17:55:05.912211 run osmo-hlr_10.42.42.2(pid=13614): stderr: | [0;m[1;31m20221213175502576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175502576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175502576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175502576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175502576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175502577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175502589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175502598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175502598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175502598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:05.965393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13613): Terminating (SIGTERM) 17:55:06.008365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13616): Terminating (SIGTERM) 17:55:06.051414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13619): Terminating (SIGTERM) 17:55:06.095265 --- ParallelTerminationStrategy: PID 13613 died... 17:55:06.115941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13613): Terminated: ok {rc=0} 17:55:06.163261 --- ParallelTerminationStrategy: PID 13616 died... 17:55:06.183454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13616): Terminated: ok {rc=0} 17:55:06.230431 --- ParallelTerminationStrategy: PID 13619 died... 17:55:06.250637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13619): Terminated: ok {rc=0} 17:55:06.340515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:55:07.644811 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:07.652294 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:55:07.685073 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:55:07.720021 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:55:07.772417 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:55:07.804775 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:55:07.839315 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:55:08.403741 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:55:08.409132 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:08.420593 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:55:08.489278 tst switch_tch_pdch.py: using LAC 35271 17:55:08.608552 tst switch_tch_pdch.py: using RAC 81 17:55:08.738228 tst switch_tch_pdch.py: using CellId 35271 17:55:08.868759 tst switch_tch_pdch.py: using BVCI 35272 17:55:08.989274 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.001236 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.012760 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.024364 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.036200 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.047968 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.059823 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:55:09.071720 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:55:09.191804 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:55:09.310686 tst switch_tch_pdch.py:51: start network... 17:55:09.515522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:09.987943 run create_hlr_db(pid=13624): Launched 17:55:10.113454 bus /gobi_6: Setting Powered False 17:55:11.174604 run create_hlr_db(pid=13624): Terminated: ok {rc=0} 17:55:11.601530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Launched 17:55:11.907425 run osmo-hlr_10.42.42.2(pid=13627): Launched 17:55:12.024583 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:12.553585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Launched 17:55:12.859047 run osmo-stp_10.42.42.5(pid=13630): Launched 17:55:12.976136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:13.503440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Launched 17:55:13.619615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:13.878226 run patchelf(pid=13633): Launched 17:55:14.049895 run osmo-stp_10.42.42.5(pid=13630): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] 17:55:14.180474 run osmo-stp_10.42.42.5(pid=13630): stdout: | (launched: 2022-12-13_17:55:12.802427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:14.311505 run osmo-stp_10.42.42.5(pid=13630): stderr: | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175512971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:14.443189 run osmo-stp_10.42.42.5(pid=13630): stdout: | (launched: 2022-12-13_17:55:12.802427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:14.567502 run osmo-stp_10.42.42.5(pid=13630): stderr: | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175512971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175512971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175512972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:14.714943 run patchelf(pid=13633): Terminating (SIGINT) 17:55:14.887260 run patchelf(pid=13633): Terminated: ok {rc=0} 17:55:15.011162 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13630): Process ended prematurely: osmo-stp_10.42.42.5(pid=13630) [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:55:15.020109 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:55:15.046950 run osmo-hlr_10.42.42.2(pid=13627): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13627)] 17:55:15.095101 run osmo-hlr_10.42.42.2(pid=13627): stdout: | (launched: 2022-12-13_17:55:11.850768) 17:55:15.146036 run osmo-hlr_10.42.42.2(pid=13627): stderr: | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175512028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175512040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175512050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175512050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175512050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:15.196585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Terminating (SIGTERM) 17:55:15.236878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Terminating (SIGTERM) 17:55:15.277323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Terminating (SIGTERM) 17:55:15.317902 --- ParallelTerminationStrategy: PID 13626 died... 17:55:15.337013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Terminated: ok {rc=0} 17:55:15.381479 --- ParallelTerminationStrategy: PID 13629 died... 17:55:15.400131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Terminated: ok {rc=0} 17:55:15.444524 --- ParallelTerminationStrategy: PID 13632 died... 17:55:15.463525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Terminated: ok {rc=0} 17:55:15.550336 bus /gobi_0: Setting Powered False 17:55:16.655513 bus /gobi_0: Setting Powered False 17:55:17.782216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:55:19.034290 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:19.040188 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:55:19.072553 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:55:19.108012 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:55:19.163615 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:55:19.198294 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:55:19.233885 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:55:19.782759 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:55:19.788843 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:19.800353 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:55:19.870730 tst switch_tch_pdch.py: using LAC 35272 17:55:19.990514 tst switch_tch_pdch.py: using RAC 82 17:55:20.112161 tst switch_tch_pdch.py: using CellId 35272 17:55:20.232423 tst switch_tch_pdch.py: using BVCI 35273 17:55:20.344336 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.355427 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.366246 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.376936 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.387679 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.398486 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.409438 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:55:20.420104 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:55:20.541489 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:55:20.660291 tst switch_tch_pdch.py:51: start network... 17:55:20.863565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:21.308320 run create_hlr_db(pid=13638): Launched 17:55:21.432260 bus /gobi_6: Setting Powered False 17:55:22.493691 run create_hlr_db(pid=13638): Terminated: ok {rc=0} 17:55:22.911663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13640): Launched 17:55:23.239637 run osmo-hlr_10.42.42.2(pid=13641): Launched 17:55:23.363763 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:23.896312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13643): Launched 17:55:24.222623 run osmo-stp_10.42.42.5(pid=13644): Launched 17:55:24.347945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:24.881614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13646): Launched 17:55:25.006577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:25.283895 run patchelf(pid=13647): Launched 17:55:25.466112 run osmo-stp_10.42.42.5(pid=13644): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13644)] 17:55:25.603830 run osmo-stp_10.42.42.5(pid=13644): stdout: | (launched: 2022-12-13_17:55:24.162567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:25.743736 run osmo-stp_10.42.42.5(pid=13644): stderr: | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175524356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:25.884223 run osmo-stp_10.42.42.5(pid=13644): stdout: | (launched: 2022-12-13_17:55:24.162567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:26.017660 run osmo-stp_10.42.42.5(pid=13644): stderr: | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175524355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175524356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175524356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:26.176176 run patchelf(pid=13647): Terminating (SIGINT) 17:55:26.360154 run patchelf(pid=13647): Terminated: ok {rc=0} 17:55:26.492748 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13644): Process ended prematurely: osmo-stp_10.42.42.5(pid=13644) [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13644)] [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:55:26.502550 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 17:55:26.530832 run osmo-hlr_10.42.42.2(pid=13641): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13641)] 17:55:26.582222 run osmo-hlr_10.42.42.2(pid=13641): stdout: | (launched: 2022-12-13_17:55:23.179532) 17:55:26.635442 run osmo-hlr_10.42.42.2(pid=13641): stderr: | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175523377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175523389 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175523397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:26.688832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13640): Terminating (SIGTERM) 17:55:26.731323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13643): Terminating (SIGTERM) 17:55:26.774423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13646): Terminating (SIGTERM) 17:55:26.817949 --- ParallelTerminationStrategy: PID 13640 died... 17:55:26.838851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13640): Terminated: ok {rc=0} 17:55:26.886320 --- ParallelTerminationStrategy: PID 13643 died... 17:55:26.906540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13643): Terminated: ok {rc=0} 17:55:26.953975 --- ParallelTerminationStrategy: PID 13646 died... 17:55:26.974279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13646): Terminated: ok {rc=0} 17:55:27.064486 bus /gobi_0: Setting Powered False 17:55:28.165106 bus /gobi_0: Setting Powered False 17:55:29.283207 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:trx-lms --------------------------------------------------------------------- 17:55:30.540423 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:30.544784 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:30.578899 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:55:30.587138 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:55:30.641315 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:30.676067 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:55:30.683752 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:55:31.248070 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:55:31.257118 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 17:55:31.268926 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 17:55:31.321093 tst mo_mt_sms.py: using LAC 35273 17:55:31.479859 tst mo_mt_sms.py: using RAC 83 17:55:31.604831 tst mo_mt_sms.py: using CellId 35273 17:55:31.733381 tst mo_mt_sms.py: using BVCI 35274 17:55:31.870441 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:32.020146 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:32.186059 tst mo_mt_sms.py:9: start nitb and bts... 17:55:32.412936 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:55:33.075233 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Launched 17:55:33.403219 run osmo-nitb_10.42.42.2(pid=13652): Launched 17:55:33.584264 run osmo-nitb_10.42.42.2(pid=13652): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] 17:55:33.730252 run osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-13_17:55:33.343053) 17:55:33.878786 run osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-13_17:55:33.391413) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:34.026712 run osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-13_17:55:33.343053) 17:55:34.168566 run osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-13_17:55:33.391413) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2392↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] 17:55:34.526932 tst osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-13_17:55:33.343053) 17:55:34.659734 tst osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-13_17:55:33.391413) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:34.816617 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2392↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] [trial-2392↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 17:55:34.825912 tst mo_mt_sms.py:11: Test FAILED (3.6 sec) 17:55:34.833369 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Terminating (SIGTERM) 17:55:35.046173 --- ParallelTerminationStrategy: PID 13651 died... 17:55:35.067785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Terminated: ok {rc=0} 17:55:35.155785 bus /sierra_3: Setting Powered False 17:55:36.257595 bus /sierra_3: Setting Powered False 17:55:37.377560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:trx-lms --------------------------------------------------------------------- 17:55:38.576085 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:38.580513 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:38.613282 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:38.640056 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:55:38.691125 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:38.723725 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:38.750270 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:55:39.297042 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:55:39.301926 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.312368 tst sms:trx-lms: Using 1 x bts (candidates: 1) 17:55:39.359381 tst mo_mt_sms.py: using LAC 35274 17:55:39.477815 tst mo_mt_sms.py: using RAC 84 17:55:39.596499 tst mo_mt_sms.py: using CellId 35274 17:55:39.716699 tst mo_mt_sms.py: using BVCI 35275 17:55:39.826269 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.836681 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.847077 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.857525 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.867771 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:39.878166 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:40.001869 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:40.122962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:40.594927 run create_hlr_db(pid=13656): Launched 17:55:40.720185 bus /sierra_2: Setting Powered False 17:55:41.781552 run create_hlr_db(pid=13656): Terminated: ok {rc=0} 17:55:42.228906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Launched 17:55:42.555214 run osmo-hlr_10.42.42.2(pid=13659): Launched 17:55:42.680868 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:43.243771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Launched 17:55:43.570287 run osmo-stp_10.42.42.5(pid=13662): Launched 17:55:43.695192 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:44.289828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13664): Launched 17:55:44.610379 run osmo-msc_10.42.42.6(pid=13665): Launched 17:55:44.787245 run osmo-stp_10.42.42.5(pid=13662): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] 17:55:44.923874 run osmo-stp_10.42.42.5(pid=13662): stdout: | (launched: 2022-12-13_17:55:43.510372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:45.059565 run osmo-stp_10.42.42.5(pid=13662): stderr: | [0;m[38;5;43m20221213175543703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175543703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175543704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175543704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175543704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175543705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175543705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:45.193394 run osmo-stp_10.42.42.5(pid=13662): stdout: | (launched: 2022-12-13_17:55:43.510372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:45.320936 run osmo-stp_10.42.42.5(pid=13662): stderr: | [0;m[38;5;43m20221213175543703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175543703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175543704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175543704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175543704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175543705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175543705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:45.473479 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13662): Process ended prematurely: osmo-stp_10.42.42.5(pid=13662) [trial-2392↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] [trial-2392↪sms:trx-lms↪mo_mt_sms.py:16] 17:55:45.482728 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 17:55:45.510343 run osmo-hlr_10.42.42.2(pid=13659): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13659)] 17:55:45.562258 run osmo-hlr_10.42.42.2(pid=13659): stdout: | (launched: 2022-12-13_17:55:42.495383) 17:55:45.615213 run osmo-hlr_10.42.42.2(pid=13659): stderr: | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175542693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175542706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175542714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175542715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175542715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:45.688542 run osmo-msc_10.42.42.6(pid=13665): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13665)] 17:55:45.739232 run osmo-msc_10.42.42.6(pid=13665): stdout: | (launched: 2022-12-13_17:55:44.550869) 17:55:45.792563 run osmo-msc_10.42.42.6(pid=13665): stderr: | [0;m[38;5;43m20221213175544870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175544870 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b77a45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175544870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175544873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175544873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175544873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175544873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:45.847433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Terminating (SIGTERM) 17:55:45.909145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Terminating (SIGTERM) 17:55:45.953342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13664): Terminating (SIGTERM) 17:55:45.998192 --- ParallelTerminationStrategy: PID 13658 died... 17:55:46.020269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Terminated: ok {rc=0} 17:55:46.070262 --- ParallelTerminationStrategy: PID 13661 died... 17:55:46.091785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Terminated: ok {rc=0} 17:55:46.140676 --- ParallelTerminationStrategy: PID 13664 died... 17:55:46.162627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13664): Terminated: ok {rc=0} 17:55:46.255443 bus /sierra_3: Setting Powered False 17:55:47.355384 bus /sierra_3: Setting Powered False 17:55:48.470913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-lms --------------------------------------------------------------------- 17:55:49.698713 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:49.702789 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:49.735091 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:55:49.742183 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:49.779489 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:49.813716 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:55:49.820749 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:50.335883 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:50.341154 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 17:55:50.351656 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:50.398268 tst assert_extension.py: using LAC 35275 17:55:50.524371 tst assert_extension.py: using RAC 85 17:55:50.640830 tst assert_extension.py: using CellId 35275 17:55:50.756122 tst assert_extension.py: using BVCI 35276 17:55:50.864422 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:50.983586 tst assert_extension.py:10: start nitb and bts... 17:55:51.199435 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:55:51.851777 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13670): Launched 17:55:52.153733 run osmo-nitb_10.42.42.2(pid=13674): Launched 17:55:52.320583 run osmo-nitb_10.42.42.2(pid=13674): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13674)] 17:55:52.454975 run osmo-nitb_10.42.42.2(pid=13674): stdout: | (launched: 2022-12-13_17:55:52.098255) 17:55:52.590913 run osmo-nitb_10.42.42.2(pid=13674): stderr: | (launched: 2022-12-13_17:55:52.142473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:52.726665 run osmo-nitb_10.42.42.2(pid=13674): stdout: | (launched: 2022-12-13_17:55:52.098255) 17:55:52.857085 run osmo-nitb_10.42.42.2(pid=13674): stderr: | (launched: 2022-12-13_17:55:52.142473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13674): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13674) [trial-2392↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13674)] 17:55:53.267175 tst osmo-nitb_10.42.42.2(pid=13674): stdout: | (launched: 2022-12-13_17:55:52.098255) 17:55:53.398821 tst osmo-nitb_10.42.42.2(pid=13674): stderr: | (launched: 2022-12-13_17:55:52.142473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:53.551209 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13674): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13674) [trial-2392↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13674)] [trial-2392↪nitb_ussd:trx-lms↪assert_extension.py:12] 17:55:53.560541 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:55:53.567754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13670): Terminating (SIGTERM) 17:55:53.779809 --- ParallelTerminationStrategy: PID 13670 died... 17:55:53.801873 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13670): Terminated: ok {rc=0} 17:55:53.893650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:trx-lms --------------------------------------------------------------------- 17:55:55.070105 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:55.074361 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:55.107077 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:55.133896 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:55.170741 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:55.205151 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:55.233166 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:55.754971 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:55.760123 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:55.770685 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:55.817055 tst assert_extension.py: using LAC 35276 17:55:55.933600 tst assert_extension.py: using RAC 86 17:55:56.059251 tst assert_extension.py: using CellId 35276 17:55:56.183020 tst assert_extension.py: using BVCI 35277 17:55:56.297221 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:56.308301 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:56.319324 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:56.330124 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:56.341314 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:56.352645 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:56.469171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:56.928825 run create_hlr_db(pid=13680): Launched 17:55:57.052455 bus /sierra_2: Setting Powered False 17:55:58.112687 run create_hlr_db(pid=13680): Terminated: ok {rc=0} 17:55:58.550952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13682): Launched 17:55:58.871962 run osmo-hlr_10.42.42.2(pid=13683): Launched 17:55:58.993803 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:59.548264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13685): Launched 17:55:59.869149 run osmo-stp_10.42.42.5(pid=13686): Launched 17:55:59.990823 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:00.568534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13688): Launched 17:56:00.898674 run osmo-msc_10.42.42.6(pid=13689): Launched 17:56:01.133998 run osmo-stp_10.42.42.5(pid=13686): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13686)] 17:56:01.355568 run osmo-stp_10.42.42.5(pid=13686): stdout: | (launched: 2022-12-13_17:55:59.810121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:01.633126 run osmo-stp_10.42.42.5(pid=13686): stderr: | [0;m[38;5;43m20221213175559997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175559997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175559998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175559998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:01.919040 run osmo-stp_10.42.42.5(pid=13686): stdout: | (launched: 2022-12-13_17:55:59.810121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:02.078487 run osmo-stp_10.42.42.5(pid=13686): stderr: | [0;m[38;5;43m20221213175559997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175559997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175559998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175559998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175559999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:02.270463 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13686): Process ended prematurely: osmo-stp_10.42.42.5(pid=13686) [trial-2392↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13686)] [trial-2392↪ussd:trx-lms↪assert_extension.py:17] 17:56:02.279771 tst assert_extension.py:17: Test FAILED (6.5 sec) 17:56:02.309603 run osmo-hlr_10.42.42.2(pid=13683): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13683)] 17:56:02.364904 run osmo-hlr_10.42.42.2(pid=13683): stdout: | (launched: 2022-12-13_17:55:58.813382) 17:56:02.420130 run osmo-hlr_10.42.42.2(pid=13683): stderr: | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175559006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175559018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175559026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175559026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175559026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:02.496207 run osmo-msc_10.42.42.6(pid=13689): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13689)] 17:56:02.549280 run osmo-msc_10.42.42.6(pid=13689): stdout: | (launched: 2022-12-13_17:56:00.830914) 17:56:02.603968 run osmo-msc_10.42.42.6(pid=13689): stderr: | [0;m[38;5;43m20221213175601498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175601498 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f754eab2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175601498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175601498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175601498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175601498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175601500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175601501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175601501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175601501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:02.657730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13682): Terminating (SIGTERM) 17:56:02.700190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13685): Terminating (SIGTERM) 17:56:02.743341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13688): Terminating (SIGTERM) 17:56:02.786763 --- ParallelTerminationStrategy: PID 13682 died... 17:56:02.807860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13682): Terminated: ok {rc=0} 17:56:02.855695 --- ParallelTerminationStrategy: PID 13685 died... 17:56:02.876261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13685): Terminated: ok {rc=0} 17:56:02.923215 --- ParallelTerminationStrategy: PID 13688 died... 17:56:02.943207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13688): Terminated: ok {rc=0} 17:56:03.032487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:56:04.238897 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:04.245709 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:56:04.278711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:56:04.305454 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:56:04.357964 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:56:04.391020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:56:04.417739 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:56:04.969657 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:56:05.024119 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.035781 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:56:05.106737 tst mo_mt_call.py: using LAC 35277 17:56:05.234912 tst mo_mt_call.py: using RAC 87 17:56:05.364879 tst mo_mt_call.py: using CellId 35277 17:56:05.491820 tst mo_mt_call.py: using BVCI 35278 17:56:05.611450 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.622981 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.634311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.645738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.657452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:05.669079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:56:05.786276 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:56:05.908348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:06.412009 run create_hlr_db(pid=13694): Launched 17:56:06.535753 bus /sierra_2: Setting Powered False 17:56:07.600077 run create_hlr_db(pid=13694): Terminated: ok {rc=0} 17:56:08.053711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13696): Launched 17:56:08.379230 run osmo-hlr_10.42.42.2(pid=13697): Launched 17:56:08.503562 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:09.063541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13699): Launched 17:56:09.389300 run osmo-stp_10.42.42.5(pid=13700): Launched 17:56:09.513546 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:10.101163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13702): Launched 17:56:10.426307 run osmo-msc_10.42.42.6(pid=13703): Launched 17:56:10.606855 run osmo-stp_10.42.42.5(pid=13700): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13700)] 17:56:10.743681 run osmo-stp_10.42.42.5(pid=13700): stdout: | (launched: 2022-12-13_17:56:09.329531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:10.882306 run osmo-stp_10.42.42.5(pid=13700): stderr: | [0;m[38;5;43m20221213175609516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175609516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175609517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175609517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:11.018314 run osmo-stp_10.42.42.5(pid=13700): stdout: | (launched: 2022-12-13_17:56:09.329531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:11.147070 run osmo-stp_10.42.42.5(pid=13700): stderr: | [0;m[38;5;43m20221213175609516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175609516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175609517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175609517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175609518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:11.302001 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13700): Process ended prematurely: osmo-stp_10.42.42.5(pid=13700) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13700)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:56:11.311625 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:56:11.339485 run osmo-hlr_10.42.42.2(pid=13697): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13697)] 17:56:11.391281 run osmo-hlr_10.42.42.2(pid=13697): stdout: | (launched: 2022-12-13_17:56:08.319564) 17:56:11.443785 run osmo-hlr_10.42.42.2(pid=13697): stderr: | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175608513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175608525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175608534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175608534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175608534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:11.516469 run osmo-msc_10.42.42.6(pid=13703): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13703)] 17:56:11.566610 run osmo-msc_10.42.42.6(pid=13703): stdout: | (launched: 2022-12-13_17:56:10.366385) 17:56:11.619179 run osmo-msc_10.42.42.6(pid=13703): stderr: | [0;m[38;5;43m20221213175610685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175610685 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc42335c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175610685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175610685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175610685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175610686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175610687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175610688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175610688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175610688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:11.671963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13696): Terminating (SIGTERM) 17:56:11.714017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13699): Terminating (SIGTERM) 17:56:11.756694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13702): Terminating (SIGTERM) 17:56:11.799528 --- ParallelTerminationStrategy: PID 13696 died... 17:56:11.820062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13696): Terminated: ok {rc=0} 17:56:11.867152 --- ParallelTerminationStrategy: PID 13699 died... 17:56:11.887410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13699): Terminated: ok {rc=0} 17:56:11.934162 --- ParallelTerminationStrategy: PID 13702 died... 17:56:11.954242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13702): Terminated: ok {rc=0} 17:56:12.042929 bus /sierra_3: Setting Powered False 17:56:13.144024 bus /sierra_3: Setting Powered False 17:56:14.261191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:56:15.411498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:15.423637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:56:15.499092 tst mo_mt_call_osmux.py: using LAC 35278 17:56:15.626033 tst mo_mt_call_osmux.py: using RAC 88 17:56:15.752612 tst mo_mt_call_osmux.py: using CellId 35278 17:56:15.880273 tst mo_mt_call_osmux.py: using BVCI 35279 17:56:16.009714 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:16.021995 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:16.033949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:16.046853 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:16.059193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:56:16.071498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:56:16.213088 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:56:16.352767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:16.868451 run create_hlr_db(pid=13705): Launched 17:56:17.025458 bus /sierra_2: Setting Powered False 17:56:18.089970 run create_hlr_db(pid=13705): Terminated: ok {rc=0} 17:56:18.543824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13707): Launched 17:56:18.870557 run osmo-hlr_10.42.42.2(pid=13708): Launched 17:56:18.994898 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:19.555159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13710): Launched 17:56:19.885266 run osmo-stp_10.42.42.5(pid=13711): Launched 17:56:20.010581 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:20.602630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13713): Launched 17:56:20.931070 run osmo-msc_10.42.42.6(pid=13714): Launched 17:56:21.112843 run osmo-stp_10.42.42.5(pid=13711): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13711)] 17:56:21.250313 run osmo-stp_10.42.42.5(pid=13711): stdout: | (launched: 2022-12-13_17:56:19.824082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:21.388406 run osmo-stp_10.42.42.5(pid=13711): stderr: | [0;m[38;5;43m20221213175620013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175620013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175620014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175620014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:21.524602 run osmo-stp_10.42.42.5(pid=13711): stdout: | (launched: 2022-12-13_17:56:19.824082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:21.654622 run osmo-stp_10.42.42.5(pid=13711): stderr: | [0;m[38;5;43m20221213175620013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175620013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175620014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175620014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175620015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:21.810676 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13711): Process ended prematurely: osmo-stp_10.42.42.5(pid=13711) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13711)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:56:21.820281 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:56:21.848307 run osmo-hlr_10.42.42.2(pid=13708): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13708)] 17:56:21.899887 run osmo-hlr_10.42.42.2(pid=13708): stdout: | (launched: 2022-12-13_17:56:18.810591) 17:56:21.952459 run osmo-hlr_10.42.42.2(pid=13708): stderr: | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175619004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175619059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175619069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175619069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175619069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:22.025670 run osmo-msc_10.42.42.6(pid=13714): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13714)] 17:56:22.076044 run osmo-msc_10.42.42.6(pid=13714): stdout: | (launched: 2022-12-13_17:56:20.870584) 17:56:22.128748 run osmo-msc_10.42.42.6(pid=13714): stderr: | [0;m[38;5;43m20221213175621187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175621187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f346b175c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175621187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175621187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175621188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175621188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175621190 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175621190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175621190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175621190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:22.181661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13707): Terminating (SIGTERM) 17:56:22.223886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13710): Terminating (SIGTERM) 17:56:22.266783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13713): Terminating (SIGTERM) 17:56:22.309570 --- ParallelTerminationStrategy: PID 13707 died... 17:56:22.330169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13707): Terminated: ok {rc=0} 17:56:22.377158 --- ParallelTerminationStrategy: PID 13710 died... 17:56:22.397145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13710): Terminated: ok {rc=0} 17:56:22.443785 --- ParallelTerminationStrategy: PID 13713 died... 17:56:22.463858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13713): Terminated: ok {rc=0} 17:56:22.553709 bus /sierra_3: Setting Powered False 17:56:23.654053 bus /sierra_3: Setting Powered False 17:56:24.774207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:56:26.025178 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:26.032059 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:56:26.065217 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:56:26.092084 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:56:26.142949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:56:26.175505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:56:26.202435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:56:26.753544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:56:26.803389 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:26.814455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:56:26.884407 tst mo_mt_call.py: using LAC 35279 17:56:27.005523 tst mo_mt_call.py: using RAC 89 17:56:27.127405 tst mo_mt_call.py: using CellId 35279 17:56:27.254406 tst mo_mt_call.py: using BVCI 35280 17:56:27.367631 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:27.378721 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:27.389451 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:27.400244 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:27.412147 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:27.426190 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:27.548223 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:27.667254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:28.171926 run create_hlr_db(pid=13719): Launched 17:56:28.296598 bus /sierra_2: Setting Powered False 17:56:29.361185 run create_hlr_db(pid=13719): Terminated: ok {rc=0} 17:56:29.815492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13721): Launched 17:56:30.143187 run osmo-hlr_10.42.42.2(pid=13722): Launched 17:56:30.266955 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:30.832100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13724): Launched 17:56:31.181744 run osmo-stp_10.42.42.5(pid=13725): Launched 17:56:31.457573 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:32.028535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13727): Launched 17:56:32.355403 run osmo-msc_10.42.42.6(pid=13728): Launched 17:56:32.528289 run osmo-stp_10.42.42.5(pid=13725): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13725)] 17:56:32.659865 run osmo-stp_10.42.42.5(pid=13725): stdout: | (launched: 2022-12-13_17:56:31.116314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:32.788569 run osmo-stp_10.42.42.5(pid=13725): stderr: | [0;m[38;5;43m20221213175631321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175631321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175631322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175631322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175631322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175631322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175631323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:32.915760 run osmo-stp_10.42.42.5(pid=13725): stdout: | (launched: 2022-12-13_17:56:31.116314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:33.036075 run osmo-stp_10.42.42.5(pid=13725): stderr: | [0;m[38;5;43m20221213175631321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175631321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175631322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175631322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175631322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175631322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175631323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:33.180288 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13725): Process ended prematurely: osmo-stp_10.42.42.5(pid=13725) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13725)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:56:33.189197 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:56:33.215471 run osmo-hlr_10.42.42.2(pid=13722): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13722)] 17:56:33.263289 run osmo-hlr_10.42.42.2(pid=13722): stdout: | (launched: 2022-12-13_17:56:30.083913) 17:56:33.312902 run osmo-hlr_10.42.42.2(pid=13722): stderr: | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175630277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175630291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175630301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175630301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175630301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:33.382526 run osmo-msc_10.42.42.6(pid=13728): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13728)] 17:56:33.430493 run osmo-msc_10.42.42.6(pid=13728): stdout: | (launched: 2022-12-13_17:56:32.299234) 17:56:33.480110 run osmo-msc_10.42.42.6(pid=13728): stderr: | [0;m[38;5;43m20221213175632569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175632569 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbe12aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175632569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175632569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175632570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175632570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175632572 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175632572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175632572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175632572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:33.530355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13721): Terminating (SIGTERM) 17:56:33.570194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13724): Terminating (SIGTERM) 17:56:33.609944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13727): Terminating (SIGTERM) 17:56:33.650232 --- ParallelTerminationStrategy: PID 13721 died... 17:56:33.669409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13721): Terminated: ok {rc=0} 17:56:33.713474 --- ParallelTerminationStrategy: PID 13724 died... 17:56:33.731985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13724): Terminated: ok {rc=0} 17:56:33.776141 --- ParallelTerminationStrategy: PID 13727 died... 17:56:33.794911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13727): Terminated: ok {rc=0} 17:56:33.881425 bus /sierra_3: Setting Powered False 17:56:34.983416 bus /sierra_3: Setting Powered False 17:56:36.097725 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:56:37.249007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.261411 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:56:37.333956 tst mo_mt_call_osmux.py: using LAC 35280 17:56:37.462645 tst mo_mt_call_osmux.py: using RAC 90 17:56:37.590762 tst mo_mt_call_osmux.py: using CellId 35280 17:56:37.717856 tst mo_mt_call_osmux.py: using BVCI 35281 17:56:37.836007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.847583 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.858867 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.870335 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.882101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:37.893764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:38.011804 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:38.134499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:38.637515 run create_hlr_db(pid=13730): Launched 17:56:38.761471 bus /sierra_2: Setting Powered False 17:56:39.826435 run create_hlr_db(pid=13730): Terminated: ok {rc=0} 17:56:40.259978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13732): Launched 17:56:40.565118 run osmo-hlr_10.42.42.2(pid=13733): Launched 17:56:40.681657 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:41.203536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13735): Launched 17:56:41.507388 run osmo-stp_10.42.42.5(pid=13736): Launched 17:56:41.624175 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:42.174094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13738): Launched 17:56:42.478375 run osmo-msc_10.42.42.6(pid=13739): Launched 17:56:42.648301 run osmo-stp_10.42.42.5(pid=13736): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13736)] 17:56:42.776857 run osmo-stp_10.42.42.5(pid=13736): stdout: | (launched: 2022-12-13_17:56:41.451274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:42.905336 run osmo-stp_10.42.42.5(pid=13736): stderr: | [0;m[38;5;43m20221213175641619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175641620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175641620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175641620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:43.032204 run osmo-stp_10.42.42.5(pid=13736): stdout: | (launched: 2022-12-13_17:56:41.451274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:43.152528 run osmo-stp_10.42.42.5(pid=13736): stderr: | [0;m[38;5;43m20221213175641619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175641620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175641620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175641620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175641621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:43.296254 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13736): Process ended prematurely: osmo-stp_10.42.42.5(pid=13736) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13736)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:56:43.305109 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:56:43.331570 run osmo-hlr_10.42.42.2(pid=13733): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13733)] 17:56:43.379292 run osmo-hlr_10.42.42.2(pid=13733): stdout: | (launched: 2022-12-13_17:56:40.509322) 17:56:43.429141 run osmo-hlr_10.42.42.2(pid=13733): stderr: | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175640684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175640696 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175640704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175640705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175640705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:43.498438 run osmo-msc_10.42.42.6(pid=13739): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13739)] 17:56:43.546122 run osmo-msc_10.42.42.6(pid=13739): stdout: | (launched: 2022-12-13_17:56:42.422532) 17:56:43.595542 run osmo-msc_10.42.42.6(pid=13739): stderr: | [0;m[38;5;43m20221213175642692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175642692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce0a7c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175642692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175642693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175642693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175642693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175642695 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175642695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175642695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175642695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:43.645275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13732): Terminating (SIGTERM) 17:56:43.685153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13735): Terminating (SIGTERM) 17:56:43.725100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13738): Terminating (SIGTERM) 17:56:43.765193 --- ParallelTerminationStrategy: PID 13732 died... 17:56:43.784611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13732): Terminated: ok {rc=0} 17:56:43.829125 --- ParallelTerminationStrategy: PID 13735 died... 17:56:43.847942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13735): Terminated: ok {rc=0} 17:56:43.891976 --- ParallelTerminationStrategy: PID 13738 died... 17:56:43.910592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13738): Terminated: ok {rc=0} 17:56:43.994358 bus /sierra_3: Setting Powered False 17:56:45.092256 bus /sierra_3: Setting Powered False 17:56:46.215361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:56:47.471496 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:47.478665 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:56:47.513026 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:56:47.540607 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:56:47.594020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:56:47.627184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:56:47.654237 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:56:48.203478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:56:48.252503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.263696 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:48.333089 tst mo_mt_call.py: using LAC 35281 17:56:48.454465 tst mo_mt_call.py: using RAC 91 17:56:48.575665 tst mo_mt_call.py: using CellId 35281 17:56:48.696446 tst mo_mt_call.py: using BVCI 35282 17:56:48.808124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.819321 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.830216 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.841000 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.852085 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:48.863083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:48.984160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:49.109566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:49.614268 run create_hlr_db(pid=13744): Launched 17:56:49.740243 bus /sierra_2: Setting Powered False 17:56:50.805402 run create_hlr_db(pid=13744): Terminated: ok {rc=0} 17:56:51.261081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13746): Launched 17:56:51.587455 run osmo-hlr_10.42.42.2(pid=13747): Launched 17:56:51.711611 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:52.271697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13749): Launched 17:56:52.597269 run osmo-stp_10.42.42.5(pid=13750): Launched 17:56:52.723580 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:53.314114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13752): Launched 17:56:53.640197 run osmo-msc_10.42.42.6(pid=13753): Launched 17:56:53.822346 run osmo-stp_10.42.42.5(pid=13750): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13750)] 17:56:53.959930 run osmo-stp_10.42.42.5(pid=13750): stdout: | (launched: 2022-12-13_17:56:52.537955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:54.098680 run osmo-stp_10.42.42.5(pid=13750): stderr: | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175652727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:54.234823 run osmo-stp_10.42.42.5(pid=13750): stdout: | (launched: 2022-12-13_17:56:52.537955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:54.364360 run osmo-stp_10.42.42.5(pid=13750): stderr: | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175652727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175652727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175652728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:54.519550 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13750): Process ended prematurely: osmo-stp_10.42.42.5(pid=13750) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13750)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:56:54.529129 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:56:54.557061 run osmo-hlr_10.42.42.2(pid=13747): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13747)] 17:56:54.608648 run osmo-hlr_10.42.42.2(pid=13747): stdout: | (launched: 2022-12-13_17:56:51.528200) 17:56:54.661351 run osmo-hlr_10.42.42.2(pid=13747): stderr: | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175651722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175651738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175651746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175651746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175651746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:54.735268 run osmo-msc_10.42.42.6(pid=13753): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13753)] 17:56:54.786050 run osmo-msc_10.42.42.6(pid=13753): stdout: | (launched: 2022-12-13_17:56:53.580644) 17:56:54.838994 run osmo-msc_10.42.42.6(pid=13753): stderr: | [0;m[38;5;43m20221213175653897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175653897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0619699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175653897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175653897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175653898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175653898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175653899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175653900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175653900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175653900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:54.891774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13746): Terminating (SIGTERM) 17:56:54.934324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13749): Terminating (SIGTERM) 17:56:54.976649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13752): Terminating (SIGTERM) 17:56:55.019334 --- ParallelTerminationStrategy: PID 13746 died... 17:56:55.039767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13746): Terminated: ok {rc=0} 17:56:55.086719 --- ParallelTerminationStrategy: PID 13749 died... 17:56:55.106615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13749): Terminated: ok {rc=0} 17:56:55.153284 --- ParallelTerminationStrategy: PID 13752 died... 17:56:55.173234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13752): Terminated: ok {rc=0} 17:56:55.262709 bus /sierra_3: Setting Powered False 17:56:56.362568 bus /sierra_3: Setting Powered False 17:56:57.480023 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:56:58.629965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:58.642209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:58.714838 tst mo_mt_call_osmux.py: using LAC 35282 17:56:58.844537 tst mo_mt_call_osmux.py: using RAC 92 17:56:58.972644 tst mo_mt_call_osmux.py: using CellId 35282 17:56:59.101346 tst mo_mt_call_osmux.py: using BVCI 35283 17:56:59.218799 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:59.230462 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:59.241804 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:59.253481 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:59.265155 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:59.276653 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:59.398009 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:59.517335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:59.988439 run create_hlr_db(pid=13755): Launched 17:57:00.112371 bus /sierra_2: Setting Powered False 17:57:01.175447 run create_hlr_db(pid=13755): Terminated: ok {rc=0} 17:57:01.641377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Launched 17:57:01.986893 run osmo-hlr_10.42.42.2(pid=13758): Launched 17:57:02.210165 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:02.766862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Launched 17:57:03.095085 run osmo-stp_10.42.42.5(pid=13761): Launched 17:57:03.218326 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:03.870153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13763): Launched 17:57:04.196716 run osmo-msc_10.42.42.6(pid=13764): Launched 17:57:04.378506 run osmo-stp_10.42.42.5(pid=13761): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] 17:57:04.515446 run osmo-stp_10.42.42.5(pid=13761): stdout: | (launched: 2022-12-13_17:57:03.035405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:04.653520 run osmo-stp_10.42.42.5(pid=13761): stderr: | [0;m[38;5;43m20221213175703222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175703222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175703223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175703223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175703223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175703224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175703224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:04.789736 run osmo-stp_10.42.42.5(pid=13761): stdout: | (launched: 2022-12-13_17:57:03.035405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:04.920448 run osmo-stp_10.42.42.5(pid=13761): stderr: | [0;m[38;5;43m20221213175703222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175703222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175703223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175703223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175703223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175703224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175703224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:05.076211 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13761): Process ended prematurely: osmo-stp_10.42.42.5(pid=13761) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:57:05.086323 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:57:05.114380 run osmo-hlr_10.42.42.2(pid=13758): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13758)] 17:57:05.166252 run osmo-hlr_10.42.42.2(pid=13758): stdout: | (launched: 2022-12-13_17:57:01.927762) 17:57:05.219015 run osmo-hlr_10.42.42.2(pid=13758): stderr: | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175702119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175702140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175702152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175702152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175702152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:05.292061 run osmo-msc_10.42.42.6(pid=13764): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13764)] 17:57:05.342711 run osmo-msc_10.42.42.6(pid=13764): stdout: | (launched: 2022-12-13_17:57:04.137111) 17:57:05.395588 run osmo-msc_10.42.42.6(pid=13764): stderr: | [0;m[38;5;43m20221213175704457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175704457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa4684c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175704457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175704457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175704458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175704458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175704459 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175704460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175704460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175704460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:05.449329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Terminating (SIGTERM) 17:57:05.491409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Terminating (SIGTERM) 17:57:05.534234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13763): Terminating (SIGTERM) 17:57:05.577248 --- ParallelTerminationStrategy: PID 13757 died... 17:57:05.597978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Terminated: ok {rc=0} 17:57:05.645284 --- ParallelTerminationStrategy: PID 13760 died... 17:57:05.665411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Terminated: ok {rc=0} 17:57:05.712331 --- ParallelTerminationStrategy: PID 13763 died... 17:57:05.732687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13763): Terminated: ok {rc=0} 17:57:05.822386 bus /sierra_3: Setting Powered False 17:57:06.921943 bus /sierra_3: Setting Powered False 17:57:08.040324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:57:09.291695 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:09.298914 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:57:09.333010 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:57:09.360908 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:57:09.416024 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:57:09.450034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:57:09.477651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:57:10.027263 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:57:10.079950 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.091727 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:57:10.162431 tst mo_mt_call.py: using LAC 35283 17:57:10.291022 tst mo_mt_call.py: using RAC 93 17:57:10.418334 tst mo_mt_call.py: using CellId 35283 17:57:10.550082 tst mo_mt_call.py: using BVCI 35284 17:57:10.670195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.681978 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.693481 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.704801 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.716651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:10.729010 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:57:10.848089 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:57:10.965160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:11.434045 run create_hlr_db(pid=13769): Launched 17:57:11.559088 bus /sierra_2: Setting Powered False 17:57:12.619694 run create_hlr_db(pid=13769): Terminated: ok {rc=0} 17:57:13.064605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13771): Launched 17:57:13.389260 run osmo-hlr_10.42.42.2(pid=13772): Launched 17:57:13.515083 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:14.080450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Launched 17:57:14.405123 run osmo-stp_10.42.42.5(pid=13775): Launched 17:57:14.531150 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:15.120521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13777): Launched 17:57:15.447068 run osmo-msc_10.42.42.6(pid=13778): Launched 17:57:15.619031 run osmo-stp_10.42.42.5(pid=13775): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13775)] 17:57:15.749417 run osmo-stp_10.42.42.5(pid=13775): stdout: | (launched: 2022-12-13_17:57:14.345876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:15.906566 run osmo-stp_10.42.42.5(pid=13775): stderr: | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175714536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:16.049585 run osmo-stp_10.42.42.5(pid=13775): stdout: | (launched: 2022-12-13_17:57:14.345876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:16.183256 run osmo-stp_10.42.42.5(pid=13775): stderr: | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175714535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175714536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175714536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:16.343316 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13775): Process ended prematurely: osmo-stp_10.42.42.5(pid=13775) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13775)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:57:16.354202 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:57:16.383764 run osmo-hlr_10.42.42.2(pid=13772): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13772)] 17:57:16.440036 run osmo-hlr_10.42.42.2(pid=13772): stdout: | (launched: 2022-12-13_17:57:13.330063) 17:57:16.496882 run osmo-hlr_10.42.42.2(pid=13772): stderr: | [0;m[1;31m20221213175713524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175713524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175713525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175713525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175713525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175713525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175713537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175713546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175713546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175713546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:16.574508 run osmo-msc_10.42.42.6(pid=13778): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13778)] 17:57:16.628697 run osmo-msc_10.42.42.6(pid=13778): stdout: | (launched: 2022-12-13_17:57:15.386649) 17:57:16.685342 run osmo-msc_10.42.42.6(pid=13778): stderr: | [0;m[38;5;43m20221213175715658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175715658 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24667ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175715658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175715658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175715659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175715659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175715660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175715661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175715661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175715661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:16.741945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13771): Terminating (SIGTERM) 17:57:16.786603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Terminating (SIGTERM) 17:57:16.834235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13777): Terminating (SIGTERM) 17:57:16.881629 --- ParallelTerminationStrategy: PID 13771 died... 17:57:16.903912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13771): Terminated: ok {rc=0} 17:57:16.953809 --- ParallelTerminationStrategy: PID 13774 died... 17:57:16.976475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Terminated: ok {rc=0} 17:57:17.026348 --- ParallelTerminationStrategy: PID 13777 died... 17:57:17.048033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13777): Terminated: ok {rc=0} 17:57:17.142458 bus /sierra_3: Setting Powered False 17:57:18.242785 bus /sierra_3: Setting Powered False 17:57:19.358901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:57:20.502462 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:20.514074 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:57:20.582586 tst mo_mt_call_osmux.py: using LAC 35284 17:57:20.702626 tst mo_mt_call_osmux.py: using RAC 94 17:57:20.821542 tst mo_mt_call_osmux.py: using CellId 35284 17:57:20.941333 tst mo_mt_call_osmux.py: using BVCI 35285 17:57:21.052774 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:21.063843 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:21.074698 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:21.085619 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:21.096421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:57:21.107268 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:57:21.229551 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:57:21.348247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:21.819544 run create_hlr_db(pid=13781): Launched 17:57:21.944172 bus /sierra_2: Setting Powered False 17:57:23.005310 run create_hlr_db(pid=13781): Terminated: ok {rc=0} 17:57:23.450641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Launched 17:57:23.781201 run osmo-hlr_10.42.42.2(pid=13784): Launched 17:57:23.905649 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:24.471357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Launched 17:57:24.798876 run osmo-stp_10.42.42.5(pid=13787): Launched 17:57:24.923837 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:25.513456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13789): Launched 17:57:25.841715 run osmo-msc_10.42.42.6(pid=13790): Launched 17:57:26.026083 run osmo-stp_10.42.42.5(pid=13787): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] 17:57:26.164818 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-13_17:57:24.739398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:26.304435 run osmo-stp_10.42.42.5(pid=13787): stderr: | [0;m[38;5;43m20221213175724927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175724927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175724928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175724928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:26.442041 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-13_17:57:24.739398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:26.572829 run osmo-stp_10.42.42.5(pid=13787): stderr: | [0;m[38;5;43m20221213175724927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175724927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175724928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175724928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175724929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:26.729815 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:57:26.739567 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:57:26.767715 run osmo-hlr_10.42.42.2(pid=13784): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13784)] 17:57:26.819330 run osmo-hlr_10.42.42.2(pid=13784): stdout: | (launched: 2022-12-13_17:57:23.721266) 17:57:26.872517 run osmo-hlr_10.42.42.2(pid=13784): stderr: | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175723916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175723928 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175723937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175723937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175723937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:26.945802 run osmo-msc_10.42.42.6(pid=13790): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13790)] 17:57:26.996855 run osmo-msc_10.42.42.6(pid=13790): stdout: | (launched: 2022-12-13_17:57:25.781819) 17:57:27.050088 run osmo-msc_10.42.42.6(pid=13790): stderr: | [0;m[38;5;43m20221213175726101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175726101 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b3739ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175726101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175726101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175726101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175726101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175726103 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175726103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175726104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175726104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:27.103237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminating (SIGTERM) 17:57:27.145502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminating (SIGTERM) 17:57:27.187996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13789): Terminating (SIGTERM) 17:57:27.230907 --- ParallelTerminationStrategy: PID 13783 died... 17:57:27.251504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminated: ok {rc=0} 17:57:27.298616 --- ParallelTerminationStrategy: PID 13786 died... 17:57:27.318811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminated: ok {rc=0} 17:57:27.365693 --- ParallelTerminationStrategy: PID 13789 died... 17:57:27.385726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13789): Terminated: ok {rc=0} 17:57:27.475179 bus /sierra_3: Setting Powered False 17:57:28.573084 bus /sierra_3: Setting Powered False 17:57:29.692249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:57:30.986743 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:30.993967 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:57:31.029170 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:57:31.057818 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:57:31.111996 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:57:31.147030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:57:31.176365 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:57:31.746536 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:57:31.797845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:31.809371 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:57:31.879493 tst mo_mt_call.py: using LAC 35285 17:57:32.012176 tst mo_mt_call.py: using RAC 95 17:57:32.133301 tst mo_mt_call.py: using CellId 35285 17:57:32.254083 tst mo_mt_call.py: using BVCI 35286 17:57:32.366597 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:32.377671 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:32.388425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:32.399210 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:32.410102 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:32.420898 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:32.536671 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:32.653432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:33.126754 run create_hlr_db(pid=13795): Launched 17:57:33.252118 bus /sierra_2: Setting Powered False 17:57:34.312459 run create_hlr_db(pid=13795): Terminated: ok {rc=0} 17:57:34.759086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Launched 17:57:35.087368 run osmo-hlr_10.42.42.2(pid=13798): Launched 17:57:35.211675 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:35.777767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Launched 17:57:36.105810 run osmo-stp_10.42.42.5(pid=13801): Launched 17:57:36.230399 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:36.822818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Launched 17:57:37.149082 run osmo-msc_10.42.42.6(pid=13804): Launched 17:57:37.331534 run osmo-stp_10.42.42.5(pid=13801): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] 17:57:37.470633 run osmo-stp_10.42.42.5(pid=13801): stdout: | (launched: 2022-12-13_17:57:36.045836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:37.609826 run osmo-stp_10.42.42.5(pid=13801): stderr: | [0;m[38;5;43m20221213175736232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175736233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175736233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175736233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:37.745638 run osmo-stp_10.42.42.5(pid=13801): stdout: | (launched: 2022-12-13_17:57:36.045836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:37.875415 run osmo-stp_10.42.42.5(pid=13801): stderr: | [0;m[38;5;43m20221213175736232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175736233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175736233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175736233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175736234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:38.030635 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13801): Process ended prematurely: osmo-stp_10.42.42.5(pid=13801) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:57:38.040245 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:57:38.068387 run osmo-hlr_10.42.42.2(pid=13798): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13798)] 17:57:38.120387 run osmo-hlr_10.42.42.2(pid=13798): stdout: | (launched: 2022-12-13_17:57:35.028031) 17:57:38.173286 run osmo-hlr_10.42.42.2(pid=13798): stderr: | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175735221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175735245 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175735255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175735255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175735255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:38.246510 run osmo-msc_10.42.42.6(pid=13804): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13804)] 17:57:38.296867 run osmo-msc_10.42.42.6(pid=13804): stdout: | (launched: 2022-12-13_17:57:37.089627) 17:57:38.349800 run osmo-msc_10.42.42.6(pid=13804): stderr: | [0;m[38;5;43m20221213175737406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175737407 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf927e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175737407 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175737407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175737407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175737407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175737409 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175737409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175737409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175737410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:38.402765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Terminating (SIGTERM) 17:57:38.444713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Terminating (SIGTERM) 17:57:38.487157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Terminating (SIGTERM) 17:57:38.529730 --- ParallelTerminationStrategy: PID 13797 died... 17:57:38.550282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Terminated: ok {rc=0} 17:57:38.597294 --- ParallelTerminationStrategy: PID 13800 died... 17:57:38.617336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Terminated: ok {rc=0} 17:57:38.664137 --- ParallelTerminationStrategy: PID 13803 died... 17:57:38.684319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Terminated: ok {rc=0} 17:57:38.774488 bus /sierra_3: Setting Powered False 17:57:39.875785 bus /sierra_3: Setting Powered False 17:57:40.994310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:57:42.146301 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.158535 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:57:42.229972 tst mo_mt_call_osmux.py: using LAC 35286 17:57:42.360284 tst mo_mt_call_osmux.py: using RAC 96 17:57:42.480735 tst mo_mt_call_osmux.py: using CellId 35286 17:57:42.600148 tst mo_mt_call_osmux.py: using BVCI 35287 17:57:42.721340 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.732813 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.744114 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.755371 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.767144 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:42.778779 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:42.897643 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:43.017324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:43.487252 run create_hlr_db(pid=13806): Launched 17:57:43.612074 bus /sierra_2: Setting Powered False 17:57:44.672281 run create_hlr_db(pid=13806): Terminated: ok {rc=0} 17:57:45.095761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13808): Launched 17:57:45.401418 run osmo-hlr_10.42.42.2(pid=13809): Launched 17:57:45.516702 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:46.077237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13811): Launched 17:57:46.482987 run osmo-stp_10.42.42.5(pid=13812): Launched 17:57:46.769315 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:47.347443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13814): Launched 17:57:47.651742 run osmo-msc_10.42.42.6(pid=13815): Launched 17:57:47.822109 run osmo-stp_10.42.42.5(pid=13812): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13812)] 17:57:47.950485 run osmo-stp_10.42.42.5(pid=13812): stdout: | (launched: 2022-12-13_17:57:46.426397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:48.078836 run osmo-stp_10.42.42.5(pid=13812): stderr: | [0;m[38;5;43m20221213175746660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175746660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175746661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175746661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:48.205604 run osmo-stp_10.42.42.5(pid=13812): stdout: | (launched: 2022-12-13_17:57:46.426397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:48.326264 run osmo-stp_10.42.42.5(pid=13812): stderr: | [0;m[38;5;43m20221213175746660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175746660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175746661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175746661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175746662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:48.471221 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13812): Process ended prematurely: osmo-stp_10.42.42.5(pid=13812) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13812)] [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:57:48.480123 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:57:48.506707 run osmo-hlr_10.42.42.2(pid=13809): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13809)] 17:57:48.554993 run osmo-hlr_10.42.42.2(pid=13809): stdout: | (launched: 2022-12-13_17:57:45.345106) 17:57:48.604830 run osmo-hlr_10.42.42.2(pid=13809): stderr: | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175745521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175745536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175745546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175745546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175745546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:48.674831 run osmo-msc_10.42.42.6(pid=13815): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13815)] 17:57:48.723283 run osmo-msc_10.42.42.6(pid=13815): stdout: | (launched: 2022-12-13_17:57:47.596250) 17:57:48.773345 run osmo-msc_10.42.42.6(pid=13815): stderr: | [0;m[38;5;43m20221213175747869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175747869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faffc915c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175747869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175747869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175747869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175747870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175747871 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175747872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175747872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175747872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:48.823668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13808): Terminating (SIGTERM) 17:57:48.863628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13811): Terminating (SIGTERM) 17:57:48.903539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13814): Terminating (SIGTERM) 17:57:48.943618 --- ParallelTerminationStrategy: PID 13808 died... 17:57:48.962861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13808): Terminated: ok {rc=0} 17:57:49.007271 --- ParallelTerminationStrategy: PID 13811 died... 17:57:49.025883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13811): Terminated: ok {rc=0} 17:57:49.069690 --- ParallelTerminationStrategy: PID 13814 died... 17:57:49.088268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13814): Terminated: ok {rc=0} 17:57:49.174247 bus /sierra_3: Setting Powered False 17:57:50.274231 bus /sierra_3: Setting Powered False 17:57:51.390831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:57:52.647533 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:52.654808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:57:52.689880 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:57:52.717517 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:57:52.770177 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:57:52.804107 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:57:52.831700 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:57:53.383800 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:57:53.437432 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:53.448862 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:57:53.521590 tst mo_mt_call.py: using LAC 35287 17:57:53.650398 tst mo_mt_call.py: using RAC 97 17:57:53.777109 tst mo_mt_call.py: using CellId 35287 17:57:53.908938 tst mo_mt_call.py: using BVCI 35288 17:57:54.028119 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:54.039716 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:54.051087 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:54.062567 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:54.074459 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:54.086193 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:54.205588 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:54.327578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:54.832154 run create_hlr_db(pid=13822): Launched 17:57:54.956818 bus /sierra_2: Setting Powered False 17:57:56.021775 run create_hlr_db(pid=13822): Terminated: ok {rc=0} 17:57:56.459271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13824): Launched 17:57:56.765468 run osmo-hlr_10.42.42.2(pid=13825): Launched 17:57:56.881710 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:57.423676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13827): Launched 17:57:57.728603 run osmo-stp_10.42.42.5(pid=13828): Launched 17:57:57.844101 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:58.396188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13830): Launched 17:57:58.701036 run osmo-msc_10.42.42.6(pid=13831): Launched 17:57:58.871004 run osmo-stp_10.42.42.5(pid=13828): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13828)] 17:57:58.999281 run osmo-stp_10.42.42.5(pid=13828): stdout: | (launched: 2022-12-13_17:57:57.672713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:59.127541 run osmo-stp_10.42.42.5(pid=13828): stderr: | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175757841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:59.254836 run osmo-stp_10.42.42.5(pid=13828): stdout: | (launched: 2022-12-13_17:57:57.672713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:59.375649 run osmo-stp_10.42.42.5(pid=13828): stderr: | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175757841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175757841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175757842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:59.519916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13828): Process ended prematurely: osmo-stp_10.42.42.5(pid=13828) [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13828)] [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:57:59.528823 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:57:59.555355 run osmo-hlr_10.42.42.2(pid=13825): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13825)] 17:57:59.603431 run osmo-hlr_10.42.42.2(pid=13825): stdout: | (launched: 2022-12-13_17:57:56.708695) 17:57:59.653221 run osmo-hlr_10.42.42.2(pid=13825): stderr: | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175756885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175756897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175756906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175756906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175756906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:59.722904 run osmo-msc_10.42.42.6(pid=13831): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13831)] 17:57:59.771070 run osmo-msc_10.42.42.6(pid=13831): stdout: | (launched: 2022-12-13_17:57:58.645055) 17:57:59.821372 run osmo-msc_10.42.42.6(pid=13831): stderr: | [0;m[38;5;43m20221213175758915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175758915 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e2bd95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175758915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175758915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175758915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175758916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175758917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175758918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175758918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175758918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:59.871339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13824): Terminating (SIGTERM) 17:57:59.911061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13827): Terminating (SIGTERM) 17:57:59.950918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13830): Terminating (SIGTERM) 17:57:59.990968 --- ParallelTerminationStrategy: PID 13824 died... 17:58:00.010245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13824): Terminated: ok {rc=0} 17:58:00.054384 --- ParallelTerminationStrategy: PID 13827 died... 17:58:00.072880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13827): Terminated: ok {rc=0} 17:58:00.117072 --- ParallelTerminationStrategy: PID 13830 died... 17:58:00.135744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13830): Terminated: ok {rc=0} 17:58:00.222642 bus /sierra_3: Setting Powered False 17:58:01.323383 bus /sierra_3: Setting Powered False 17:58:02.443613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:58:03.591505 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:03.603454 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:58:03.672832 tst mo_mt_call_osmux.py: using LAC 35288 17:58:03.791911 tst mo_mt_call_osmux.py: using RAC 98 17:58:03.911329 tst mo_mt_call_osmux.py: using CellId 35288 17:58:04.032450 tst mo_mt_call_osmux.py: using BVCI 35289 17:58:04.144620 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:04.155849 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:04.166886 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:04.178020 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:04.189111 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:58:04.199950 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:58:04.316532 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:58:04.438451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:04.943845 run create_hlr_db(pid=13833): Launched 17:58:05.068895 bus /sierra_2: Setting Powered False 17:58:06.133823 run create_hlr_db(pid=13833): Terminated: ok {rc=0} 17:58:06.571155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Launched 17:58:06.876233 run osmo-hlr_10.42.42.2(pid=13836): Launched 17:58:06.992193 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:07.518542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Launched 17:58:07.824121 run osmo-stp_10.42.42.5(pid=13839): Launched 17:58:07.939505 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:08.497274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13841): Launched 17:58:08.803062 run osmo-msc_10.42.42.6(pid=13842): Launched 17:58:08.973218 run osmo-stp_10.42.42.5(pid=13839): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] 17:58:09.102357 run osmo-stp_10.42.42.5(pid=13839): stdout: | (launched: 2022-12-13_17:58:07.767975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:09.231142 run osmo-stp_10.42.42.5(pid=13839): stderr: | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175807938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:09.359502 run osmo-stp_10.42.42.5(pid=13839): stdout: | (launched: 2022-12-13_17:58:07.767975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:09.480660 run osmo-stp_10.42.42.5(pid=13839): stderr: | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175807937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175807938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175807938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:09.625878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13839): Process ended prematurely: osmo-stp_10.42.42.5(pid=13839) [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:58:09.634983 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:58:09.661269 run osmo-hlr_10.42.42.2(pid=13836): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13836)] 17:58:09.709206 run osmo-hlr_10.42.42.2(pid=13836): stdout: | (launched: 2022-12-13_17:58:06.820259) 17:58:09.758892 run osmo-hlr_10.42.42.2(pid=13836): stderr: | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175806993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175807006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175807014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175807014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175807014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:09.828254 run osmo-msc_10.42.42.6(pid=13842): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13842)] 17:58:09.875964 run osmo-msc_10.42.42.6(pid=13842): stdout: | (launched: 2022-12-13_17:58:08.746818) 17:58:09.925530 run osmo-msc_10.42.42.6(pid=13842): stderr: | [0;m[38;5;43m20221213175809016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175809017 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0974dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175809017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175809017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175809017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175809017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175809019 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175809019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175809020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175809020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:09.975545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Terminating (SIGTERM) 17:58:10.015172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Terminating (SIGTERM) 17:58:10.054897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13841): Terminating (SIGTERM) 17:58:10.095160 --- ParallelTerminationStrategy: PID 13835 died... 17:58:10.114446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Terminated: ok {rc=0} 17:58:10.158992 --- ParallelTerminationStrategy: PID 13838 died... 17:58:10.177844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Terminated: ok {rc=0} 17:58:10.221942 --- ParallelTerminationStrategy: PID 13841 died... 17:58:10.240719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13841): Terminated: ok {rc=0} 17:58:10.326529 bus /sierra_3: Setting Powered False 17:58:11.426769 bus /sierra_3: Setting Powered False 17:58:12.540691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:58:13.786983 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:13.792725 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:58:13.825729 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:58:13.852410 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:58:13.903113 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:58:13.935576 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:58:13.962413 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:58:14.511841 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:58:14.561934 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:14.573274 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:14.643787 tst mo_mt_call.py: using LAC 35289 17:58:14.763914 tst mo_mt_call.py: using RAC 99 17:58:14.884567 tst mo_mt_call.py: using CellId 35289 17:58:15.015534 tst mo_mt_call.py: using BVCI 35290 17:58:15.126907 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:15.137964 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:15.148753 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:15.159531 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:15.170167 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:15.180844 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:15.302890 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:15.422331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:15.904390 run create_hlr_db(pid=13847): Launched 17:58:16.040921 bus /sierra_2: Setting Powered False 17:58:17.107069 run create_hlr_db(pid=13847): Terminated: ok {rc=0} 17:58:17.567448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Launched 17:58:17.896588 run osmo-hlr_10.42.42.2(pid=13850): Launched 17:58:18.022181 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:18.581379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Launched 17:58:18.907557 run osmo-stp_10.42.42.5(pid=13853): Launched 17:58:19.031182 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:19.619897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13855): Launched 17:58:19.949186 run osmo-msc_10.42.42.6(pid=13856): Launched 17:58:20.131049 run osmo-stp_10.42.42.5(pid=13853): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] 17:58:20.273448 run osmo-stp_10.42.42.5(pid=13853): stdout: | (launched: 2022-12-13_17:58:18.847568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:20.408668 run osmo-stp_10.42.42.5(pid=13853): stderr: | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175819035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:20.544710 run osmo-stp_10.42.42.5(pid=13853): stdout: | (launched: 2022-12-13_17:58:18.847568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:20.674684 run osmo-stp_10.42.42.5(pid=13853): stderr: | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175819035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175819035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175819036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:20.830363 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13853): Process ended prematurely: osmo-stp_10.42.42.5(pid=13853) [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:58:20.840149 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:58:20.868412 run osmo-hlr_10.42.42.2(pid=13850): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13850)] 17:58:20.920322 run osmo-hlr_10.42.42.2(pid=13850): stdout: | (launched: 2022-12-13_17:58:17.836934) 17:58:20.972829 run osmo-hlr_10.42.42.2(pid=13850): stderr: | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175818030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175818043 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175818052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175818052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175818052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:21.046301 run osmo-msc_10.42.42.6(pid=13856): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13856)] 17:58:21.097053 run osmo-msc_10.42.42.6(pid=13856): stdout: | (launched: 2022-12-13_17:58:19.889252) 17:58:21.150390 run osmo-msc_10.42.42.6(pid=13856): stderr: | [0;m[38;5;43m20221213175820207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175820207 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c472f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175820207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175820207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175820207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175820207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175820209 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175820210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175820210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175820210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:21.203738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Terminating (SIGTERM) 17:58:21.246204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Terminating (SIGTERM) 17:58:21.289382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13855): Terminating (SIGTERM) 17:58:21.332529 --- ParallelTerminationStrategy: PID 13849 died... 17:58:21.353364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Terminated: ok {rc=0} 17:58:21.400627 --- ParallelTerminationStrategy: PID 13852 died... 17:58:21.421061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Terminated: ok {rc=0} 17:58:21.468213 --- ParallelTerminationStrategy: PID 13855 died... 17:58:21.488499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13855): Terminated: ok {rc=0} 17:58:21.578083 bus /sierra_3: Setting Powered False 17:58:22.679226 bus /sierra_3: Setting Powered False 17:58:23.798481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:58:24.951613 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:24.963792 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:25.036185 tst mo_mt_call_osmux.py: using LAC 35290 17:58:25.163535 tst mo_mt_call_osmux.py: using RAC 100 17:58:25.292400 tst mo_mt_call_osmux.py: using CellId 35290 17:58:25.420732 tst mo_mt_call_osmux.py: using BVCI 35291 17:58:25.534257 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:25.545413 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:25.556158 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:25.566939 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:25.578077 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:25.589842 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:25.711043 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:25.831815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:26.304476 run create_hlr_db(pid=13858): Launched 17:58:26.429228 bus /sierra_2: Setting Powered False 17:58:27.490982 run create_hlr_db(pid=13858): Terminated: ok {rc=0} 17:58:27.938329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Launched 17:58:28.263989 run osmo-hlr_10.42.42.2(pid=13861): Launched 17:58:28.387949 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:28.951517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Launched 17:58:29.278666 run osmo-stp_10.42.42.5(pid=13864): Launched 17:58:29.402743 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:29.991949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13866): Launched 17:58:30.318232 run osmo-msc_10.42.42.6(pid=13867): Launched 17:58:30.501827 run osmo-stp_10.42.42.5(pid=13864): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] 17:58:30.639296 run osmo-stp_10.42.42.5(pid=13864): stdout: | (launched: 2022-12-13_17:58:29.218948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:30.777814 run osmo-stp_10.42.42.5(pid=13864): stderr: | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175829407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:30.947174 run osmo-stp_10.42.42.5(pid=13864): stdout: | (launched: 2022-12-13_17:58:29.218948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:31.077705 run osmo-stp_10.42.42.5(pid=13864): stderr: | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175829406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175829407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175829407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:31.226724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13864): Process ended prematurely: osmo-stp_10.42.42.5(pid=13864) [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:58:31.236673 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:58:31.265788 run osmo-hlr_10.42.42.2(pid=13861): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13861)] 17:58:31.316736 run osmo-hlr_10.42.42.2(pid=13861): stdout: | (launched: 2022-12-13_17:58:28.204662) 17:58:31.368818 run osmo-hlr_10.42.42.2(pid=13861): stderr: | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175828397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175828414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175828423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175828423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175828424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:31.440776 run osmo-msc_10.42.42.6(pid=13867): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13867)] 17:58:31.491654 run osmo-msc_10.42.42.6(pid=13867): stdout: | (launched: 2022-12-13_17:58:30.258669) 17:58:31.544379 run osmo-msc_10.42.42.6(pid=13867): stderr: | [0;m[38;5;43m20221213175830576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175830577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9329523c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175830577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175830577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175830577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175830577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175830579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175830579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175830580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175830580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:31.596871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Terminating (SIGTERM) 17:58:31.639126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Terminating (SIGTERM) 17:58:31.685837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13866): Terminating (SIGTERM) 17:58:31.730356 --- ParallelTerminationStrategy: PID 13860 died... 17:58:31.750307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Terminated: ok {rc=0} 17:58:31.797781 --- ParallelTerminationStrategy: PID 13863 died... 17:58:31.817802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Terminated: ok {rc=0} 17:58:31.865090 --- ParallelTerminationStrategy: PID 13866 died... 17:58:31.885042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13866): Terminated: ok {rc=0} 17:58:31.977421 bus /sierra_3: Setting Powered False 17:58:33.089319 bus /sierra_3: Setting Powered False 17:58:34.206680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:trx-lms --------------------------------------------------------------------- 17:58:35.464366 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:35.469215 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 17:58:35.502949 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:58:35.531557 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 17:58:35.617429 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 17:58:35.651363 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:58:35.679014 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 17:58:36.267139 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 17:58:36.272339 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.283367 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:58:36.334215 tst emergency_mo_mt_call.py: using LAC 35291 17:58:36.458753 tst emergency_mo_mt_call.py: using RAC 101 17:58:36.605894 tst emergency_mo_mt_call.py: using CellId 35291 17:58:36.729764 tst emergency_mo_mt_call.py: using BVCI 35292 17:58:36.847900 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.859006 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.870363 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.881356 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.892549 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:36.903701 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:37.025783 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:37.145274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:37.610342 run create_hlr_db(pid=13872): Launched 17:58:37.734819 bus /sierra_2: Setting Powered False 17:58:38.794538 run create_hlr_db(pid=13872): Terminated: ok {rc=0} 17:58:39.233712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Launched 17:58:39.555190 run osmo-hlr_10.42.42.2(pid=13875): Launched 17:58:39.678857 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:40.232449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Launched 17:58:40.552560 run osmo-stp_10.42.42.5(pid=13878): Launched 17:58:40.686552 tst emergency_mo_mt_call.py: using MSISDN 8255 17:58:40.854881 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:41.434932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Launched 17:58:41.754781 run osmo-msc_10.42.42.6(pid=13881): Launched 17:58:41.934817 run osmo-stp_10.42.42.5(pid=13878): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] 17:58:42.069378 run osmo-stp_10.42.42.5(pid=13878): stdout: | (launched: 2022-12-13_17:58:40.494299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:42.204805 run osmo-stp_10.42.42.5(pid=13878): stderr: | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175840684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:42.339297 run osmo-stp_10.42.42.5(pid=13878): stdout: | (launched: 2022-12-13_17:58:40.494299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:42.467069 run osmo-stp_10.42.42.5(pid=13878): stderr: | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175840683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175840684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175840685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:42.619853 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13878): Process ended prematurely: osmo-stp_10.42.42.5(pid=13878) [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 17:58:42.628755 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 17:58:42.656205 run osmo-hlr_10.42.42.2(pid=13875): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13875)] 17:58:42.707358 run osmo-hlr_10.42.42.2(pid=13875): stdout: | (launched: 2022-12-13_17:58:39.496786) 17:58:42.760741 run osmo-hlr_10.42.42.2(pid=13875): stderr: | [0;m[1;31m20221213175839689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175839689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175839690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175839690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175839690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175839690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175839702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175839712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:42.833956 run osmo-msc_10.42.42.6(pid=13881): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13881)] 17:58:42.884833 run osmo-msc_10.42.42.6(pid=13881): stdout: | (launched: 2022-12-13_17:58:41.696330) 17:58:42.937786 run osmo-msc_10.42.42.6(pid=13881): stderr: | [0;m[38;5;43m20221213175842015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175842015 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9fd78f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175842015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175842015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175842015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175842015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175842017 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175842018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175842018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175842018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:42.990889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Terminating (SIGTERM) 17:58:43.032741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Terminating (SIGTERM) 17:58:43.075506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Terminating (SIGTERM) 17:58:43.118296 --- ParallelTerminationStrategy: PID 13874 died... 17:58:43.138773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Terminated: ok {rc=0} 17:58:43.185674 --- ParallelTerminationStrategy: PID 13877 died... 17:58:43.205716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Terminated: ok {rc=0} 17:58:43.252574 --- ParallelTerminationStrategy: PID 13880 died... 17:58:43.272649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Terminated: ok {rc=0} 17:58:43.361932 bus /sierra_3: Setting Powered False 17:58:44.460715 bus /sierra_3: Setting Powered False 17:58:45.577145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 17:58:46.672424 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:46.690275 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:58:46.749346 tst emergency_preemptive_call.py: using LAC 35292 17:58:46.914735 tst emergency_preemptive_call.py: using RAC 102 17:58:47.099901 tst emergency_preemptive_call.py: using CellId 35292 17:58:47.255580 tst emergency_preemptive_call.py: using BVCI 35293 17:58:47.381086 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:47.392592 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:47.403979 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:47.415404 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:47.427179 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:47.438466 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:47.557688 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:47.678142 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:47.792682 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:47.912202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:48.408753 run create_hlr_db(pid=13883): Launched 17:58:48.531697 bus /sierra_2: Setting Powered False 17:58:49.596085 run create_hlr_db(pid=13883): Terminated: ok {rc=0} 17:58:50.024079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Launched 17:58:50.323367 run osmo-hlr_10.42.42.2(pid=13886): Launched 17:58:50.439151 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:50.954344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13888): Launched 17:58:51.252761 run osmo-stp_10.42.42.5(pid=13889): Launched 17:58:51.377215 tst emergency_preemptive_call.py: using MSISDN 8256 17:58:51.528758 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:52.069366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13891): Launched 17:58:52.370405 run osmo-msc_10.42.42.6(pid=13892): Launched 17:58:52.538705 run osmo-stp_10.42.42.5(pid=13889): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13889)] 17:58:52.665117 run osmo-stp_10.42.42.5(pid=13889): stdout: | (launched: 2022-12-13_17:58:51.197968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:52.791491 run osmo-stp_10.42.42.5(pid=13889): stderr: | [0;m[38;5;43m20221213175851364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175851365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175851365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175851365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:52.916863 run osmo-stp_10.42.42.5(pid=13889): stdout: | (launched: 2022-12-13_17:58:51.197968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:53.036542 run osmo-stp_10.42.42.5(pid=13889): stderr: | [0;m[38;5;43m20221213175851364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175851365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175851365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175851365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175851366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:53.179391 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13889): Process ended prematurely: osmo-stp_10.42.42.5(pid=13889) [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13889)] [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py:32] 17:58:53.187956 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 17:58:53.214356 run osmo-hlr_10.42.42.2(pid=13886): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13886)] 17:58:53.263110 run osmo-hlr_10.42.42.2(pid=13886): stdout: | (launched: 2022-12-13_17:58:50.268564) 17:58:53.313434 run osmo-hlr_10.42.42.2(pid=13886): stderr: | [0;m[1;31m20221213175850439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175850439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175850439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175850439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175850440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175850440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175850452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175850461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175850462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175850462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:53.384057 run osmo-msc_10.42.42.6(pid=13892): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13892)] 17:58:53.432479 run osmo-msc_10.42.42.6(pid=13892): stdout: | (launched: 2022-12-13_17:58:52.314757) 17:58:53.482790 run osmo-msc_10.42.42.6(pid=13892): stderr: | [0;m[38;5;43m20221213175852585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213175852585 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f051698dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213175852585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213175852585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213175852585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213175852585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213175852587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213175852588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213175852588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213175852588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:53.533223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminating (SIGTERM) 17:58:53.574117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13888): Terminating (SIGTERM) 17:58:53.614647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13891): Terminating (SIGTERM) 17:58:53.654942 --- ParallelTerminationStrategy: PID 13885 died... 17:58:53.674657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminated: ok {rc=0} 17:58:53.719266 --- ParallelTerminationStrategy: PID 13888 died... 17:58:53.738340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13888): Terminated: ok {rc=0} 17:58:53.782822 --- ParallelTerminationStrategy: PID 13891 died... 17:58:53.801931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13891): Terminated: ok {rc=0} 17:58:53.889538 bus /sierra_9: Setting Powered False 17:58:54.989970 bus /sierra_9: Setting Powered False 17:58:56.107250 bus /sierra_8: Setting Powered False 17:58:57.207744 bus /sierra_8: Setting Powered False 17:58:58.323173 bus /sierra_3: Setting Powered False 17:58:59.423064 bus /sierra_3: Setting Powered False 17:59:00.537300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms --------------------------------------------------------------------- 17:59:01.823282 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:01.828142 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 17:59:01.869644 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 17:59:01.909133 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 17:59:01.996320 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 17:59:02.032133 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 17:59:02.073568 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 17:59:02.660920 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 17:59:02.715676 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:02.726829 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:02.777716 tst cs_paging_gprs_active.py: using LAC 35293 17:59:02.898816 tst cs_paging_gprs_active.py: using RAC 103 17:59:03.020590 tst cs_paging_gprs_active.py: using CellId 35293 17:59:03.141378 tst cs_paging_gprs_active.py: using BVCI 35294 17:59:03.254438 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.265501 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.275952 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.286272 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.296424 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.307706 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.318686 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.329611 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.340460 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:03.462583 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:03.580743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:59:03.787217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:04.093490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13898): Launched 17:59:04.361080 run iperf3-srv_10.42.42.10(pid=13899): Launched 17:59:04.474886 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:59:04.679849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:04.985689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13900): Launched 17:59:05.252710 run iperf3-srv_10.42.42.10(pid=13901): Launched 17:59:05.366472 tst cs_paging_gprs_active.py:38: start network... 17:59:05.569733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:06.041461 run create_hlr_db(pid=13902): Launched 17:59:06.165780 bus /sierra_2: Setting Powered False 17:59:07.226142 run create_hlr_db(pid=13902): Terminated: ok {rc=0} 17:59:07.651995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13904): Launched 17:59:07.958430 run osmo-hlr_10.42.42.2(pid=13905): Launched 17:59:08.073731 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:08.596070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13907): Launched 17:59:08.902945 run osmo-stp_10.42.42.5(pid=13908): Launched 17:59:09.019063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:09.544376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13910): Launched 17:59:09.662138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:09.921029 run patchelf(pid=13911): Launched 17:59:10.091659 run osmo-stp_10.42.42.5(pid=13908): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] 17:59:10.221895 run osmo-stp_10.42.42.5(pid=13908): stdout: | (launched: 2022-12-13_17:59:08.846233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:10.353227 run osmo-stp_10.42.42.5(pid=13908): stderr: | [0;m[38;5;43m20221213175909013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175909014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175909014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175909014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:10.484632 run osmo-stp_10.42.42.5(pid=13908): stdout: | (launched: 2022-12-13_17:59:08.846233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:10.609764 run osmo-stp_10.42.42.5(pid=13908): stderr: | [0;m[38;5;43m20221213175909013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175909014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175909014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175909014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175909015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:10.758031 run patchelf(pid=13911): Terminating (SIGINT) 17:59:10.931936 run patchelf(pid=13911): Terminated: ok {rc=0} 17:59:11.057084 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13908): Process ended prematurely: osmo-stp_10.42.42.5(pid=13908) [trial-2392↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] [trial-2392↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 17:59:11.066626 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 17:59:11.093787 run osmo-hlr_10.42.42.2(pid=13905): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13905)] 17:59:11.141629 run osmo-hlr_10.42.42.2(pid=13905): stdout: | (launched: 2022-12-13_17:59:07.902314) 17:59:11.191039 run osmo-hlr_10.42.42.2(pid=13905): stderr: | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175908076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175908091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175908102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175908102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175908102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:11.240814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13898): Terminating (SIGTERM) 17:59:11.280920 run iperf3-srv_10.42.42.10(pid=13899): Terminating (SIGTERM) 17:59:11.320834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13900): Terminating (SIGTERM) 17:59:11.361144 run iperf3-srv_10.42.42.10(pid=13901): Terminating (SIGTERM) 17:59:11.401146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13904): Terminating (SIGTERM) 17:59:11.441199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13907): Terminating (SIGTERM) 17:59:11.481133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13910): Terminating (SIGTERM) 17:59:11.521421 --- ParallelTerminationStrategy: PID 13898 died... 17:59:11.540719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13898): Terminated: ok {rc=0} 17:59:11.585075 --- ParallelTerminationStrategy: PID 13899 died... 17:59:11.603680 run iperf3-srv_10.42.42.10(pid=13899): Terminated {rc=256} 17:59:11.647675 --- ParallelTerminationStrategy: PID 13900 died... 17:59:11.666626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13900): Terminated: ok {rc=0} 17:59:11.710731 --- ParallelTerminationStrategy: PID 13901 died... 17:59:11.729451 run iperf3-srv_10.42.42.10(pid=13901): Terminated {rc=256} 17:59:11.773525 --- ParallelTerminationStrategy: PID 13904 died... 17:59:11.792269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13904): Terminated: ok {rc=0} 17:59:11.836829 --- ParallelTerminationStrategy: PID 13907 died... 17:59:11.856241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13907): Terminated: ok {rc=0} 17:59:11.901172 --- ParallelTerminationStrategy: PID 13910 died... 17:59:11.920453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13910): Terminated: ok {rc=0} 17:59:12.007498 bus /gobi_0: Setting Powered False 17:59:13.106312 bus /gobi_0: Setting Powered False 17:59:14.222547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms iperf3.py ---------------------------------------------- 17:59:15.374002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.385688 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:15.438629 tst iperf3.py: using LAC 35294 17:59:15.568830 tst iperf3.py: using RAC 104 17:59:15.690346 tst iperf3.py: using CellId 35294 17:59:15.811310 tst iperf3.py: using BVCI 35295 17:59:15.943499 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.955179 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.966528 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.978214 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:15.989788 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:16.000641 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:16.012328 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:16.023459 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:16.034624 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:16.155337 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:16.399555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:16.721406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Launched 17:59:17.007205 run iperf3-srv_10.42.42.10(pid=13913): Launched 17:59:17.138738 tst iperf3.py:8: start network... 17:59:17.345042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:17.817671 run create_hlr_db(pid=13914): Launched 17:59:17.943557 bus /gobi_6: Setting Powered False 17:59:19.003842 run create_hlr_db(pid=13914): Terminated: ok {rc=0} 17:59:19.429561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Launched 17:59:19.736403 run osmo-hlr_10.42.42.2(pid=13917): Launched 17:59:19.853589 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:20.394772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Launched 17:59:20.699818 run osmo-stp_10.42.42.5(pid=13920): Launched 17:59:20.815387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:21.339544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Launched 17:59:21.456107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:21.714373 run patchelf(pid=13923): Launched 17:59:21.886494 run osmo-stp_10.42.42.5(pid=13920): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] 17:59:22.016867 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-13_17:59:20.643715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:22.148041 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175920812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175920812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175920813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175920813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:22.279052 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-13_17:59:20.643715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:22.403566 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175920811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175920812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175920812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175920813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175920813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:22.551425 run patchelf(pid=13923): Terminating (SIGINT) 17:59:22.725870 run patchelf(pid=13923): Terminated: ok {rc=0} 17:59:22.851035 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2392↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] [trial-2392↪gprs:trx-lms↪iperf3.py:8] 17:59:22.860342 tst iperf3.py:8: Test FAILED (7.5 sec) 17:59:22.887558 run osmo-hlr_10.42.42.2(pid=13917): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13917)] 17:59:22.935548 run osmo-hlr_10.42.42.2(pid=13917): stdout: | (launched: 2022-12-13_17:59:19.679871) 17:59:22.985450 run osmo-hlr_10.42.42.2(pid=13917): stderr: | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175919857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175919868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175919879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175919879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175919879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:23.035815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Terminating (SIGTERM) 17:59:23.076012 run iperf3-srv_10.42.42.10(pid=13913): Terminating (SIGTERM) 17:59:23.116001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminating (SIGTERM) 17:59:23.156067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminating (SIGTERM) 17:59:23.195995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Terminating (SIGTERM) 17:59:23.236307 --- ParallelTerminationStrategy: PID 13912 died... 17:59:23.255891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Terminated: ok {rc=0} 17:59:23.300074 --- ParallelTerminationStrategy: PID 13913 died... 17:59:23.318759 run iperf3-srv_10.42.42.10(pid=13913): Terminated {rc=256} 17:59:23.362653 --- ParallelTerminationStrategy: PID 13916 died... 17:59:23.381346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminated: ok {rc=0} 17:59:23.425187 --- ParallelTerminationStrategy: PID 13919 died... 17:59:23.443785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminated: ok {rc=0} 17:59:23.487699 --- ParallelTerminationStrategy: PID 13922 died... 17:59:23.506361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Terminated: ok {rc=0} 17:59:23.592178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms iperf3m4.py ---------------------------------------------- 17:59:24.741365 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:24.752454 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:24.802016 tst iperf3m4.py: using LAC 35295 17:59:24.932286 tst iperf3m4.py: using RAC 105 17:59:25.062220 tst iperf3m4.py: using CellId 35295 17:59:25.192437 tst iperf3m4.py: using BVCI 35296 17:59:25.313960 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.325418 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.336467 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.347645 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.359702 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.371538 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.383638 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.395611 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:25.407665 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:25.527836 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:25.653279 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:25.772725 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:25.895166 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:26.116906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:26.445219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13924): Launched 17:59:26.729289 run iperf3-srv_10.42.42.10(pid=13925): Launched 17:59:26.853234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:59:27.074787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:27.403632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13926): Launched 17:59:27.688552 run iperf3-srv_10.42.42.10(pid=13927): Launched 17:59:27.811379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:59:28.033284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:28.362104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Launched 17:59:28.646809 run iperf3-srv_10.42.42.10(pid=13929): Launched 17:59:28.763169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:59:28.967657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:29.274264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Launched 17:59:29.540726 run iperf3-srv_10.42.42.10(pid=13931): Launched 17:59:29.656560 tst iperf3m4.py:8: start network... 17:59:29.861952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:30.336843 run create_hlr_db(pid=13932): Launched 17:59:30.462173 bus /gobi_6: Setting Powered False 17:59:31.525662 run create_hlr_db(pid=13932): Terminated: ok {rc=0} 17:59:32.003048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Launched 17:59:32.358699 run osmo-hlr_10.42.42.2(pid=13935): Launched 17:59:32.477554 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:33.005234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Launched 17:59:33.311929 run osmo-stp_10.42.42.5(pid=13938): Launched 17:59:33.427621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:33.953205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Launched 17:59:34.070786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:34.329377 run patchelf(pid=13941): Launched 17:59:34.500464 run osmo-stp_10.42.42.5(pid=13938): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] 17:59:34.630582 run osmo-stp_10.42.42.5(pid=13938): stdout: | (launched: 2022-12-13_17:59:33.255214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:34.761984 run osmo-stp_10.42.42.5(pid=13938): stderr: | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175933425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:34.893359 run osmo-stp_10.42.42.5(pid=13938): stdout: | (launched: 2022-12-13_17:59:33.255214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:35.018573 run osmo-stp_10.42.42.5(pid=13938): stderr: | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175933424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175933425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175933425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:35.166661 run patchelf(pid=13941): Terminating (SIGINT) 17:59:35.341290 run patchelf(pid=13941): Terminated: ok {rc=0} 17:59:35.466590 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13938): Process ended prematurely: osmo-stp_10.42.42.5(pid=13938) [trial-2392↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] [trial-2392↪gprs:trx-lms↪iperf3m4.py:8] 17:59:35.475947 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:59:35.503376 run osmo-hlr_10.42.42.2(pid=13935): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13935)] 17:59:35.551185 run osmo-hlr_10.42.42.2(pid=13935): stdout: | (launched: 2022-12-13_17:59:32.302260) 17:59:35.601157 run osmo-hlr_10.42.42.2(pid=13935): stderr: | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175932476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175932491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175932502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175932502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175932502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:35.651046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13924): Terminating (SIGTERM) 17:59:35.690989 run iperf3-srv_10.42.42.10(pid=13925): Terminating (SIGTERM) 17:59:35.730835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13926): Terminating (SIGTERM) 17:59:35.770760 run iperf3-srv_10.42.42.10(pid=13927): Terminating (SIGTERM) 17:59:35.810467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminating (SIGTERM) 17:59:35.850481 run iperf3-srv_10.42.42.10(pid=13929): Terminating (SIGTERM) 17:59:35.890323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminating (SIGTERM) 17:59:35.930210 run iperf3-srv_10.42.42.10(pid=13931): Terminating (SIGTERM) 17:59:35.969846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Terminating (SIGTERM) 17:59:36.009937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Terminating (SIGTERM) 17:59:36.050141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Terminating (SIGTERM) 17:59:36.090112 --- ParallelTerminationStrategy: PID 13924 died... 17:59:36.109653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13924): Terminated: ok {rc=0} 17:59:36.154117 --- ParallelTerminationStrategy: PID 13925 died... 17:59:36.173094 run iperf3-srv_10.42.42.10(pid=13925): Terminated {rc=256} 17:59:36.217202 --- ParallelTerminationStrategy: PID 13926 died... 17:59:36.235941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13926): Terminated: ok {rc=0} 17:59:36.280237 --- ParallelTerminationStrategy: PID 13927 died... 17:59:36.299042 run iperf3-srv_10.42.42.10(pid=13927): Terminated {rc=256} 17:59:36.343271 --- ParallelTerminationStrategy: PID 13928 died... 17:59:36.362224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminated: ok {rc=0} 17:59:36.406255 --- ParallelTerminationStrategy: PID 13929 died... 17:59:36.425123 run iperf3-srv_10.42.42.10(pid=13929): Terminated {rc=256} 17:59:36.469362 --- ParallelTerminationStrategy: PID 13930 died... 17:59:36.488286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminated: ok {rc=0} 17:59:36.533153 --- ParallelTerminationStrategy: PID 13931 died... 17:59:36.551960 run iperf3-srv_10.42.42.10(pid=13931): Terminated {rc=256} 17:59:36.596209 --- ParallelTerminationStrategy: PID 13934 died... 17:59:36.615165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Terminated: ok {rc=0} 17:59:36.659219 --- ParallelTerminationStrategy: PID 13937 died... 17:59:36.678245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Terminated: ok {rc=0} 17:59:36.722473 --- ParallelTerminationStrategy: PID 13940 died... 17:59:36.741309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Terminated: ok {rc=0} 17:59:36.827591 bus /gobi_4: Setting Powered False 17:59:37.928473 bus /gobi_4: Setting Powered False 17:59:39.044095 bus /gobi_1: Setting Powered False 17:59:40.143214 bus /gobi_1: Setting Powered False 17:59:41.259521 bus /gobi_0: Setting Powered False 17:59:42.359275 bus /gobi_0: Setting Powered False 17:59:43.476397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms ping.py ---------------------------------------------- 17:59:44.580486 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:44.591879 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:44.640826 tst ping.py: using LAC 35296 17:59:44.758939 tst ping.py: using RAC 106 17:59:44.877623 tst ping.py: using CellId 35296 17:59:44.996454 tst ping.py: using BVCI 35297 17:59:45.104914 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.115727 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.126255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.136653 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.147045 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.157804 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.168876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:45.179387 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:45.295983 tst ping.py:19: start network... 17:59:45.498501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:45.999411 run create_hlr_db(pid=13947): Launched 17:59:46.155702 bus /gobi_6: Setting Powered False 17:59:47.222024 run create_hlr_db(pid=13947): Terminated: ok {rc=0} 17:59:47.650036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13949): Launched 17:59:47.954269 run osmo-hlr_10.42.42.2(pid=13950): Launched 17:59:48.069560 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:48.590598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13952): Launched 17:59:48.894068 run osmo-stp_10.42.42.5(pid=13953): Launched 17:59:49.008069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:49.526563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13955): Launched 17:59:49.641457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:49.896139 run patchelf(pid=13956): Launched 17:59:50.063079 run osmo-stp_10.42.42.5(pid=13953): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13953)] 17:59:50.191371 run osmo-stp_10.42.42.5(pid=13953): stdout: | (launched: 2022-12-13_17:59:48.837857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:50.321185 run osmo-stp_10.42.42.5(pid=13953): stderr: | [0;m[38;5;43m20221213175949005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175949006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175949006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175949006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:50.450882 run osmo-stp_10.42.42.5(pid=13953): stdout: | (launched: 2022-12-13_17:59:48.837857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:50.574708 run osmo-stp_10.42.42.5(pid=13953): stderr: | [0;m[38;5;43m20221213175949005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175949006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175949006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175949006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175949007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:50.721338 run patchelf(pid=13956): Terminating (SIGINT) 17:59:50.892077 run patchelf(pid=13956): Terminated: ok {rc=0} 17:59:51.015821 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13953): Process ended prematurely: osmo-stp_10.42.42.5(pid=13953) [trial-2392↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13953)] [trial-2392↪gprs:trx-lms↪ping.py:22] 17:59:51.024681 tst ping.py:22: Test FAILED (6.4 sec) 17:59:51.051533 run osmo-hlr_10.42.42.2(pid=13950): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13950)] 17:59:51.100009 run osmo-hlr_10.42.42.2(pid=13950): stdout: | (launched: 2022-12-13_17:59:47.898322) 17:59:51.150113 run osmo-hlr_10.42.42.2(pid=13950): stderr: | [0;m[1;31m20221213175948072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175948073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175948073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175948073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175948073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175948073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175948085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175948094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175948094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175948094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:51.200529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13949): Terminating (SIGTERM) 17:59:51.240486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13952): Terminating (SIGTERM) 17:59:51.280493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13955): Terminating (SIGTERM) 17:59:51.320723 --- ParallelTerminationStrategy: PID 13949 died... 17:59:51.339768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13949): Terminated: ok {rc=0} 17:59:51.384141 --- ParallelTerminationStrategy: PID 13952 died... 17:59:51.402952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13952): Terminated: ok {rc=0} 17:59:51.447254 --- ParallelTerminationStrategy: PID 13955 died... 17:59:51.466413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13955): Terminated: ok {rc=0} 17:59:51.550209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 17:59:52.638771 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:52.650595 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:52.702036 tst ping_idle_ping.py: using LAC 35297 17:59:52.830457 tst ping_idle_ping.py: using RAC 107 17:59:52.960675 tst ping_idle_ping.py: using CellId 35297 17:59:53.088746 tst ping_idle_ping.py: using BVCI 35298 17:59:53.206166 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.217213 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.228328 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.239166 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.250831 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.262605 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.274438 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:53.286235 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:53.408480 tst ping_idle_ping.py:24: start network... 17:59:53.626528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:54.127472 run create_hlr_db(pid=13957): Launched 17:59:54.251336 bus /gobi_6: Setting Powered False 17:59:55.315690 run create_hlr_db(pid=13957): Terminated: ok {rc=0} 17:59:55.749526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13959): Launched 17:59:56.053539 run osmo-hlr_10.42.42.2(pid=13960): Launched 17:59:56.168380 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:56.705534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13962): Launched 17:59:57.008400 run osmo-stp_10.42.42.5(pid=13963): Launched 17:59:57.123028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:57.643816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13965): Launched 17:59:57.759304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:58.015322 run patchelf(pid=13966): Launched 17:59:58.183149 run osmo-stp_10.42.42.5(pid=13963): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13963)] 17:59:58.311601 run osmo-stp_10.42.42.5(pid=13963): stdout: | (launched: 2022-12-13_17:59:56.952410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:58.441126 run osmo-stp_10.42.42.5(pid=13963): stderr: | [0;m[38;5;43m20221213175957120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175957120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175957121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175957121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:58.570629 run osmo-stp_10.42.42.5(pid=13963): stdout: | (launched: 2022-12-13_17:59:56.952410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:58.693721 run osmo-stp_10.42.42.5(pid=13963): stderr: | [0;m[38;5;43m20221213175957120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213175957120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213175957121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213175957121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213175957122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:58.839840 run patchelf(pid=13966): Terminating (SIGINT) 17:59:59.010912 run patchelf(pid=13966): Terminated: ok {rc=0} 17:59:59.134581 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13963): Process ended prematurely: osmo-stp_10.42.42.5(pid=13963) [trial-2392↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13963)] [trial-2392↪gprs:trx-lms↪ping_idle_ping.py:27] 17:59:59.143460 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:59:59.170256 run osmo-hlr_10.42.42.2(pid=13960): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13960)] 17:59:59.218026 run osmo-hlr_10.42.42.2(pid=13960): stdout: | (launched: 2022-12-13_17:59:55.997343) 17:59:59.267535 run osmo-hlr_10.42.42.2(pid=13960): stderr: | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213175956171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213175956183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213175956191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213175956191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213175956191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:59.317610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13959): Terminating (SIGTERM) 17:59:59.357738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13962): Terminating (SIGTERM) 17:59:59.397631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13965): Terminating (SIGTERM) 17:59:59.438053 --- ParallelTerminationStrategy: PID 13959 died... 17:59:59.457474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13959): Terminated: ok {rc=0} 17:59:59.501940 --- ParallelTerminationStrategy: PID 13962 died... 17:59:59.520624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13962): Terminated: ok {rc=0} 17:59:59.565029 --- ParallelTerminationStrategy: PID 13965 died... 17:59:59.583940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13965): Terminated: ok {rc=0} 17:59:59.668430 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 18:00:00.973329 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:00.978844 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:00:01.016484 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:00:01.056145 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:00:01.142494 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:00:01.178089 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:00:01.222196 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:00:01.830971 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:00:01.892003 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:01.906023 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:01.966189 tst cs_paging_gprs_active.py: using LAC 35298 18:00:02.145290 tst cs_paging_gprs_active.py: using RAC 108 18:00:02.291435 tst cs_paging_gprs_active.py: using CellId 35298 18:00:02.462447 tst cs_paging_gprs_active.py: using BVCI 35299 18:00:02.601768 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.616416 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.629965 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.642176 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.655672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.667877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.679076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.690025 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:02.701219 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:02.822187 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:02.944526 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:00:03.167207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:03.498259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13994): Launched 18:00:03.786599 run iperf3-srv_10.42.42.10(pid=13995): Launched 18:00:03.910171 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:00:04.133075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:04.464842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13996): Launched 18:00:04.753399 run iperf3-srv_10.42.42.10(pid=13997): Launched 18:00:04.877603 tst cs_paging_gprs_active.py:38: start network... 18:00:05.099250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:05.607131 run create_hlr_db(pid=13998): Launched 18:00:05.733428 bus /gobi_6: Setting Powered False 18:00:06.798204 run create_hlr_db(pid=13998): Terminated: ok {rc=0} 18:00:07.238274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14000): Launched 18:00:07.546555 run osmo-hlr_10.42.42.2(pid=14001): Launched 18:00:07.665980 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:08.201717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Launched 18:00:08.509705 run osmo-stp_10.42.42.5(pid=14005): Launched 18:00:08.627255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:09.159087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14007): Launched 18:00:09.279003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:09.538927 run patchelf(pid=14008): Launched 18:00:09.711470 run osmo-stp_10.42.42.5(pid=14005): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] 18:00:09.841830 run osmo-stp_10.42.42.5(pid=14005): stdout: | (launched: 2022-12-13_18:00:08.453143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:09.973756 run osmo-stp_10.42.42.5(pid=14005): stderr: | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180008622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:10.105391 run osmo-stp_10.42.42.5(pid=14005): stdout: | (launched: 2022-12-13_18:00:08.453143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:10.231167 run osmo-stp_10.42.42.5(pid=14005): stderr: | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180008621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180008622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180008622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:10.379996 run patchelf(pid=14008): Terminating (SIGINT) 18:00:10.555176 run patchelf(pid=14008): Terminated: ok {rc=0} 18:00:10.681129 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14005): Process ended prematurely: osmo-stp_10.42.42.5(pid=14005) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:00:10.690623 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:00:10.717685 run osmo-hlr_10.42.42.2(pid=14001): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14001)] 18:00:10.765896 run osmo-hlr_10.42.42.2(pid=14001): stdout: | (launched: 2022-12-13_18:00:07.489652) 18:00:10.815173 run osmo-hlr_10.42.42.2(pid=14001): stderr: | [0;m[1;31m20221213180007664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180007664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180007664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180007664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180007664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180007665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180007676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180007685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180007685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180007685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:10.865408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13994): Terminating (SIGTERM) 18:00:10.905227 run iperf3-srv_10.42.42.10(pid=13995): Terminating (SIGTERM) 18:00:10.945006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13996): Terminating (SIGTERM) 18:00:10.984636 run iperf3-srv_10.42.42.10(pid=13997): Terminating (SIGTERM) 18:00:11.024275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14000): Terminating (SIGTERM) 18:00:11.064196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Terminating (SIGTERM) 18:00:11.103956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14007): Terminating (SIGTERM) 18:00:11.143980 --- ParallelTerminationStrategy: PID 13994 died... 18:00:11.163344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13994): Terminated: ok {rc=0} 18:00:11.207442 --- ParallelTerminationStrategy: PID 13995 died... 18:00:11.226135 run iperf3-srv_10.42.42.10(pid=13995): Terminated {rc=256} 18:00:11.270026 --- ParallelTerminationStrategy: PID 13996 died... 18:00:11.288732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13996): Terminated: ok {rc=0} 18:00:11.332717 --- ParallelTerminationStrategy: PID 13997 died... 18:00:11.351335 run iperf3-srv_10.42.42.10(pid=13997): Terminated {rc=256} 18:00:11.395515 --- ParallelTerminationStrategy: PID 14000 died... 18:00:11.414192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14000): Terminated: ok {rc=0} 18:00:11.458222 --- ParallelTerminationStrategy: PID 14004 died... 18:00:11.477030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Terminated: ok {rc=0} 18:00:11.520877 --- ParallelTerminationStrategy: PID 14007 died... 18:00:11.540138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14007): Terminated: ok {rc=0} 18:00:11.625964 bus /gobi_0: Setting Powered False 18:00:12.726630 bus /gobi_0: Setting Powered False 18:00:13.841830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:00:14.987398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:14.998800 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:15.048855 tst iperf3.py: using LAC 35299 18:00:15.169368 tst iperf3.py: using RAC 109 18:00:15.289050 tst iperf3.py: using CellId 35299 18:00:15.409323 tst iperf3.py: using BVCI 35300 18:00:15.519538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.530495 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.541166 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.551720 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.562299 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.572826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.583633 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.594197 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:15.604836 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:15.721292 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:15.940583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:16.254955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14010): Launched 18:00:16.541260 run iperf3-srv_10.42.42.10(pid=14011): Launched 18:00:16.672289 tst iperf3.py:8: start network... 18:00:16.881233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:17.360371 run create_hlr_db(pid=14012): Launched 18:00:17.486348 bus /gobi_6: Setting Powered False 18:00:18.547143 run create_hlr_db(pid=14012): Terminated: ok {rc=0} 18:00:18.995465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14014): Launched 18:00:19.323014 run osmo-hlr_10.42.42.2(pid=14015): Launched 18:00:19.450073 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:20.015233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14017): Launched 18:00:20.345681 run osmo-stp_10.42.42.5(pid=14018): Launched 18:00:20.470432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:21.034483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14020): Launched 18:00:21.161626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:21.438611 run patchelf(pid=14021): Launched 18:00:21.623021 run osmo-stp_10.42.42.5(pid=14018): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14018)] 18:00:21.761561 run osmo-stp_10.42.42.5(pid=14018): stdout: | (launched: 2022-12-13_18:00:20.285240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:21.901658 run osmo-stp_10.42.42.5(pid=14018): stderr: | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180020476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:22.042316 run osmo-stp_10.42.42.5(pid=14018): stdout: | (launched: 2022-12-13_18:00:20.285240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:22.175989 run osmo-stp_10.42.42.5(pid=14018): stderr: | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180020476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180020476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180020477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:22.334678 run patchelf(pid=14021): Terminating (SIGINT) 18:00:22.520420 run patchelf(pid=14021): Terminated: ok {rc=0} 18:00:22.654029 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14018): Process ended prematurely: osmo-stp_10.42.42.5(pid=14018) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14018)] [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 18:00:22.664724 tst iperf3.py:8: Test FAILED (7.7 sec) 18:00:22.693497 run osmo-hlr_10.42.42.2(pid=14015): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14015)] 18:00:22.745104 run osmo-hlr_10.42.42.2(pid=14015): stdout: | (launched: 2022-12-13_18:00:19.263150) 18:00:22.798000 run osmo-hlr_10.42.42.2(pid=14015): stderr: | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180019458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180019470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180019479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180019479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180019479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:22.851197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14010): Terminating (SIGTERM) 18:00:22.893629 run iperf3-srv_10.42.42.10(pid=14011): Terminating (SIGTERM) 18:00:22.937142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14014): Terminating (SIGTERM) 18:00:22.980269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14017): Terminating (SIGTERM) 18:00:23.023572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14020): Terminating (SIGTERM) 18:00:23.066709 --- ParallelTerminationStrategy: PID 14010 died... 18:00:23.087417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14010): Terminated: ok {rc=0} 18:00:23.134757 --- ParallelTerminationStrategy: PID 14011 died... 18:00:23.155053 run iperf3-srv_10.42.42.10(pid=14011): Terminated {rc=256} 18:00:23.202028 --- ParallelTerminationStrategy: PID 14014 died... 18:00:23.222191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14014): Terminated: ok {rc=0} 18:00:23.269199 --- ParallelTerminationStrategy: PID 14017 died... 18:00:23.289315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14017): Terminated: ok {rc=0} 18:00:23.336351 --- ParallelTerminationStrategy: PID 14020 died... 18:00:23.356625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14020): Terminated: ok {rc=0} 18:00:23.446499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:00:24.602667 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:24.614780 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:24.665891 tst iperf3m4.py: using LAC 35300 18:00:24.785392 tst iperf3m4.py: using RAC 110 18:00:24.903349 tst iperf3m4.py: using CellId 35300 18:00:25.022385 tst iperf3m4.py: using BVCI 35301 18:00:25.134823 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.145792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.156555 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.167405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.178481 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.189712 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.200882 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.211999 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:25.223196 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:25.343778 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:25.465578 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:25.587103 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:25.706421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:25.911991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:26.220932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14022): Launched 18:00:26.491871 run iperf3-srv_10.42.42.10(pid=14023): Launched 18:00:26.609355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:00:26.814979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:27.123183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Launched 18:00:27.390920 run iperf3-srv_10.42.42.10(pid=14025): Launched 18:00:27.507433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:00:27.712595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:28.021086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14026): Launched 18:00:28.288698 run iperf3-srv_10.42.42.10(pid=14027): Launched 18:00:28.403289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:00:28.608227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:28.916257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14028): Launched 18:00:29.183981 run iperf3-srv_10.42.42.10(pid=14029): Launched 18:00:29.298576 tst iperf3m4.py:8: start network... 18:00:29.503632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:29.979253 run create_hlr_db(pid=14030): Launched 18:00:30.103592 bus /gobi_6: Setting Powered False 18:00:31.163328 run create_hlr_db(pid=14030): Terminated: ok {rc=0} 18:00:31.606033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14032): Launched 18:00:31.931812 run osmo-hlr_10.42.42.2(pid=14033): Launched 18:00:32.102454 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:32.691211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14035): Launched 18:00:33.021562 run osmo-stp_10.42.42.5(pid=14036): Launched 18:00:33.146416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:33.712507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14038): Launched 18:00:33.839475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:34.117812 run patchelf(pid=14039): Launched 18:00:34.301495 run osmo-stp_10.42.42.5(pid=14036): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14036)] 18:00:34.441497 run osmo-stp_10.42.42.5(pid=14036): stdout: | (launched: 2022-12-13_18:00:32.960655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:34.583270 run osmo-stp_10.42.42.5(pid=14036): stderr: | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180033151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:34.724649 run osmo-stp_10.42.42.5(pid=14036): stdout: | (launched: 2022-12-13_18:00:32.960655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:34.859522 run osmo-stp_10.42.42.5(pid=14036): stderr: | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180033150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180033151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180033151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:35.019977 run patchelf(pid=14039): Terminating (SIGINT) 18:00:35.207943 run patchelf(pid=14039): Terminated: ok {rc=0} 18:00:35.343156 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14036): Process ended prematurely: osmo-stp_10.42.42.5(pid=14036) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14036)] [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 18:00:35.353394 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:00:35.382655 run osmo-hlr_10.42.42.2(pid=14033): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14033)] 18:00:35.434891 run osmo-hlr_10.42.42.2(pid=14033): stdout: | (launched: 2022-12-13_18:00:31.874239) 18:00:35.487964 run osmo-hlr_10.42.42.2(pid=14033): stderr: | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180032222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180032235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180032243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180032243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180032244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:35.541608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14022): Terminating (SIGTERM) 18:00:35.584420 run iperf3-srv_10.42.42.10(pid=14023): Terminating (SIGTERM) 18:00:35.627418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Terminating (SIGTERM) 18:00:35.670707 run iperf3-srv_10.42.42.10(pid=14025): Terminating (SIGTERM) 18:00:35.713626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14026): Terminating (SIGTERM) 18:00:35.756736 run iperf3-srv_10.42.42.10(pid=14027): Terminating (SIGTERM) 18:00:35.799631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14028): Terminating (SIGTERM) 18:00:35.842856 run iperf3-srv_10.42.42.10(pid=14029): Terminating (SIGTERM) 18:00:35.885659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14032): Terminating (SIGTERM) 18:00:35.928869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14035): Terminating (SIGTERM) 18:00:35.972170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14038): Terminating (SIGTERM) 18:00:36.015574 --- ParallelTerminationStrategy: PID 14022 died... 18:00:36.036516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14022): Terminated: ok {rc=0} 18:00:36.083957 --- ParallelTerminationStrategy: PID 14023 died... 18:00:36.104199 run iperf3-srv_10.42.42.10(pid=14023): Terminated {rc=256} 18:00:36.150908 --- ParallelTerminationStrategy: PID 14024 died... 18:00:36.171127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Terminated: ok {rc=0} 18:00:36.217878 --- ParallelTerminationStrategy: PID 14025 died... 18:00:36.237988 run iperf3-srv_10.42.42.10(pid=14025): Terminated {rc=256} 18:00:36.284735 --- ParallelTerminationStrategy: PID 14026 died... 18:00:36.305066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14026): Terminated: ok {rc=0} 18:00:36.351831 --- ParallelTerminationStrategy: PID 14027 died... 18:00:36.371968 run iperf3-srv_10.42.42.10(pid=14027): Terminated {rc=256} 18:00:36.418748 --- ParallelTerminationStrategy: PID 14028 died... 18:00:36.438851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14028): Terminated: ok {rc=0} 18:00:36.485794 --- ParallelTerminationStrategy: PID 14029 died... 18:00:36.506098 run iperf3-srv_10.42.42.10(pid=14029): Terminated {rc=256} 18:00:36.552505 --- ParallelTerminationStrategy: PID 14032 died... 18:00:36.572618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14032): Terminated: ok {rc=0} 18:00:36.619926 --- ParallelTerminationStrategy: PID 14035 died... 18:00:36.640183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14035): Terminated: ok {rc=0} 18:00:36.687629 --- ParallelTerminationStrategy: PID 14038 died... 18:00:36.707913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14038): Terminated: ok {rc=0} 18:00:36.798087 bus /gobi_4: Setting Powered False 18:00:37.897923 bus /gobi_4: Setting Powered False 18:00:39.016702 bus /gobi_1: Setting Powered False 18:00:40.116079 bus /gobi_1: Setting Powered False 18:00:41.234354 bus /gobi_0: Setting Powered False 18:00:42.332851 bus /gobi_0: Setting Powered False 18:00:43.451469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 18:00:44.555217 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:44.567272 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:44.620110 tst ping.py: using LAC 35301 18:00:44.747450 tst ping.py: using RAC 111 18:00:44.873421 tst ping.py: using CellId 35301 18:00:44.991310 tst ping.py: using BVCI 35302 18:00:45.110083 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.121596 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.132897 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.144177 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.155671 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.167237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.178969 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:45.190444 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:45.306513 tst ping.py:19: start network... 18:00:45.507310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:45.972186 run create_hlr_db(pid=14041): Launched 18:00:46.131576 bus /gobi_6: Setting Powered False 18:00:47.207546 run create_hlr_db(pid=14041): Terminated: ok {rc=0} 18:00:47.630948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14043): Launched 18:00:47.930915 run osmo-hlr_10.42.42.2(pid=14044): Launched 18:00:48.046408 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:48.565801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14046): Launched 18:00:48.868250 run osmo-stp_10.42.42.5(pid=14047): Launched 18:00:48.981184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:49.500290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14049): Launched 18:00:49.615298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:49.870475 run patchelf(pid=14050): Launched 18:00:50.039995 run osmo-stp_10.42.42.5(pid=14047): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14047)] 18:00:50.167573 run osmo-stp_10.42.42.5(pid=14047): stdout: | (launched: 2022-12-13_18:00:48.812131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:50.297211 run osmo-stp_10.42.42.5(pid=14047): stderr: | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180048980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:50.426404 run osmo-stp_10.42.42.5(pid=14047): stdout: | (launched: 2022-12-13_18:00:48.812131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:50.549760 run osmo-stp_10.42.42.5(pid=14047): stderr: | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180048980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180048980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180048981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:50.696365 run patchelf(pid=14050): Terminating (SIGINT) 18:00:50.867271 run patchelf(pid=14050): Terminated: ok {rc=0} 18:00:50.989783 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14047): Process ended prematurely: osmo-stp_10.42.42.5(pid=14047) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14047)] [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 18:00:50.998649 tst ping.py:22: Test FAILED (6.4 sec) 18:00:51.025504 run osmo-hlr_10.42.42.2(pid=14044): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14044)] 18:00:51.073397 run osmo-hlr_10.42.42.2(pid=14044): stdout: | (launched: 2022-12-13_18:00:47.875206) 18:00:51.122962 run osmo-hlr_10.42.42.2(pid=14044): stderr: | [0;m[1;31m20221213180048046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180048046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180048046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180048047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180048047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180048047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180048060 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180048068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180048068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180048068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:51.173188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14043): Terminating (SIGTERM) 18:00:51.213486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14046): Terminating (SIGTERM) 18:00:51.253543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14049): Terminating (SIGTERM) 18:00:51.294321 --- ParallelTerminationStrategy: PID 14043 died... 18:00:51.313821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14043): Terminated: ok {rc=0} 18:00:51.358423 --- ParallelTerminationStrategy: PID 14046 died... 18:00:51.377364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14046): Terminated: ok {rc=0} 18:00:51.421627 --- ParallelTerminationStrategy: PID 14049 died... 18:00:51.440324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14049): Terminated: ok {rc=0} 18:00:51.524273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:00:52.609835 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:52.621957 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:52.673507 tst ping_idle_ping.py: using LAC 35302 18:00:52.792609 tst ping_idle_ping.py: using RAC 112 18:00:52.911808 tst ping_idle_ping.py: using CellId 35302 18:00:53.030821 tst ping_idle_ping.py: using BVCI 35303 18:00:53.142418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.153622 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.164550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.175415 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.186064 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.196657 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.207484 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:53.218669 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:53.334792 tst ping_idle_ping.py:24: start network... 18:00:53.538247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:54.007117 run create_hlr_db(pid=14052): Launched 18:00:54.129614 bus /gobi_6: Setting Powered False 18:00:55.190221 run create_hlr_db(pid=14052): Terminated: ok {rc=0} 18:00:55.631569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Launched 18:00:55.954803 run osmo-hlr_10.42.42.2(pid=14055): Launched 18:00:56.079973 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:56.637703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Launched 18:00:56.960674 run osmo-stp_10.42.42.5(pid=14058): Launched 18:00:57.084775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:57.645096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Launched 18:00:57.760935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:58.016050 run patchelf(pid=14061): Launched 18:00:58.184295 run osmo-stp_10.42.42.5(pid=14058): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] 18:00:58.311935 run osmo-stp_10.42.42.5(pid=14058): stdout: | (launched: 2022-12-13_18:00:56.901302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:58.442500 run osmo-stp_10.42.42.5(pid=14058): stderr: | [0;m[38;5;43m20221213180057088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180057088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180057089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180057089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180057089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180057090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180057090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:58.572382 run osmo-stp_10.42.42.5(pid=14058): stdout: | (launched: 2022-12-13_18:00:56.901302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:58.696700 run osmo-stp_10.42.42.5(pid=14058): stderr: | [0;m[38;5;43m20221213180057088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180057088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180057089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180057089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180057089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180057090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180057090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:58.842841 run patchelf(pid=14061): Terminating (SIGINT) 18:00:59.014185 run patchelf(pid=14061): Terminated: ok {rc=0} 18:00:59.137901 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14058): Process ended prematurely: osmo-stp_10.42.42.5(pid=14058) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 18:00:59.146828 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:00:59.173889 run osmo-hlr_10.42.42.2(pid=14055): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14055)] 18:00:59.221539 run osmo-hlr_10.42.42.2(pid=14055): stdout: | (launched: 2022-12-13_18:00:55.895183) 18:00:59.270678 run osmo-hlr_10.42.42.2(pid=14055): stderr: | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180056089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180056101 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180056109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180056109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180056109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:59.320594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Terminating (SIGTERM) 18:00:59.360264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Terminating (SIGTERM) 18:00:59.399857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Terminating (SIGTERM) 18:00:59.440274 --- ParallelTerminationStrategy: PID 14054 died... 18:00:59.459543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Terminated: ok {rc=0} 18:00:59.503365 --- ParallelTerminationStrategy: PID 14057 died... 18:00:59.522092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Terminated: ok {rc=0} 18:00:59.566129 --- ParallelTerminationStrategy: PID 14060 died... 18:00:59.584886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Terminated: ok {rc=0} 18:00:59.671662 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:01:00.994030 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:01:01.005199 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:01:01.051574 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:01:01.104753 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:01:01.218556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:01:01.254072 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:01:01.295650 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:01:01.916582 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:01:01.983457 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:01.995387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:02.070631 tst cs_paging_gprs_active.py: using LAC 35303 18:01:02.203943 tst cs_paging_gprs_active.py: using RAC 113 18:01:02.342224 tst cs_paging_gprs_active.py: using CellId 35303 18:01:02.470143 tst cs_paging_gprs_active.py: using BVCI 35304 18:01:02.591057 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.602688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.614212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.625638 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.637821 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.650008 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.662239 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.675208 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:02.687266 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:02.809428 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:02.931502 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:01:03.154877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:03.486444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14065): Launched 18:01:03.775092 run iperf3-srv_10.42.42.10(pid=14066): Launched 18:01:03.898448 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:01:04.121217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:04.452409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14067): Launched 18:01:04.741848 run iperf3-srv_10.42.42.10(pid=14068): Launched 18:01:04.866205 tst cs_paging_gprs_active.py:38: start network... 18:01:05.089553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:05.601315 run create_hlr_db(pid=14069): Launched 18:01:05.726286 bus /gobi_6: Setting Powered False 18:01:06.791265 run create_hlr_db(pid=14069): Terminated: ok {rc=0} 18:01:07.250051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Launched 18:01:07.578846 run osmo-hlr_10.42.42.2(pid=14072): Launched 18:01:07.705832 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:08.270417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Launched 18:01:08.599374 run osmo-stp_10.42.42.5(pid=14075): Launched 18:01:08.726081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:09.293523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Launched 18:01:09.422271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:09.708887 run patchelf(pid=14078): Launched 18:01:09.894530 run osmo-stp_10.42.42.5(pid=14075): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] 18:01:10.035445 run osmo-stp_10.42.42.5(pid=14075): stdout: | (launched: 2022-12-13_18:01:08.539207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:10.176865 run osmo-stp_10.42.42.5(pid=14075): stderr: | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180108730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:10.318385 run osmo-stp_10.42.42.5(pid=14075): stdout: | (launched: 2022-12-13_18:01:08.539207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:10.453570 run osmo-stp_10.42.42.5(pid=14075): stderr: | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180108730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180108730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180108731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:10.614182 run patchelf(pid=14078): Terminating (SIGINT) 18:01:10.801668 run patchelf(pid=14078): Terminated: ok {rc=0} 18:01:10.936762 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14075): Process ended prematurely: osmo-stp_10.42.42.5(pid=14075) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:01:10.947099 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:01:10.976352 run osmo-hlr_10.42.42.2(pid=14072): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14072)] 18:01:11.028115 run osmo-hlr_10.42.42.2(pid=14072): stdout: | (launched: 2022-12-13_18:01:07.518498) 18:01:11.081298 run osmo-hlr_10.42.42.2(pid=14072): stderr: | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180107715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180107727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180107736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180107736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180107736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:11.134431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14065): Terminating (SIGTERM) 18:01:11.176907 run iperf3-srv_10.42.42.10(pid=14066): Terminating (SIGTERM) 18:01:11.219693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14067): Terminating (SIGTERM) 18:01:11.262601 run iperf3-srv_10.42.42.10(pid=14068): Terminating (SIGTERM) 18:01:11.305372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Terminating (SIGTERM) 18:01:11.348084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Terminating (SIGTERM) 18:01:11.390815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Terminating (SIGTERM) 18:01:11.434181 --- ParallelTerminationStrategy: PID 14065 died... 18:01:11.454968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14065): Terminated: ok {rc=0} 18:01:11.502197 --- ParallelTerminationStrategy: PID 14066 died... 18:01:11.522296 run iperf3-srv_10.42.42.10(pid=14066): Terminated {rc=256} 18:01:11.568885 --- ParallelTerminationStrategy: PID 14067 died... 18:01:11.589577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14067): Terminated: ok {rc=0} 18:01:11.636761 --- ParallelTerminationStrategy: PID 14068 died... 18:01:11.657120 run iperf3-srv_10.42.42.10(pid=14068): Terminated {rc=256} 18:01:11.704105 --- ParallelTerminationStrategy: PID 14071 died... 18:01:11.724446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Terminated: ok {rc=0} 18:01:11.771319 --- ParallelTerminationStrategy: PID 14074 died... 18:01:11.791642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Terminated: ok {rc=0} 18:01:11.838469 --- ParallelTerminationStrategy: PID 14077 died... 18:01:11.858789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Terminated: ok {rc=0} 18:01:11.948232 bus /gobi_0: Setting Powered False 18:01:13.048534 bus /gobi_0: Setting Powered False 18:01:14.166170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:01:15.317497 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.329628 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:15.401936 tst iperf3.py: using LAC 35304 18:01:15.532139 tst iperf3.py: using RAC 114 18:01:15.662543 tst iperf3.py: using CellId 35304 18:01:15.791047 tst iperf3.py: using BVCI 35305 18:01:15.934219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.946540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.959158 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.971293 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.984240 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:15.997526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:16.009915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:16.023150 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:16.035953 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:16.173041 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:16.399814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:16.735474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14079): Launched 18:01:17.032929 run iperf3-srv_10.42.42.10(pid=14080): Launched 18:01:17.171387 tst iperf3.py:8: start network... 18:01:17.396759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:17.905275 run create_hlr_db(pid=14081): Launched 18:01:18.031562 bus /gobi_6: Setting Powered False 18:01:19.096056 run create_hlr_db(pid=14081): Terminated: ok {rc=0} 18:01:19.536088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14083): Launched 18:01:19.844081 run osmo-hlr_10.42.42.2(pid=14084): Launched 18:01:19.960939 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:20.505552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14086): Launched 18:01:20.814069 run osmo-stp_10.42.42.5(pid=14087): Launched 18:01:20.932275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:21.462493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14089): Launched 18:01:21.580792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:21.841192 run patchelf(pid=14090): Launched 18:01:22.012463 run osmo-stp_10.42.42.5(pid=14087): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14087)] 18:01:22.142947 run osmo-stp_10.42.42.5(pid=14087): stdout: | (launched: 2022-12-13_18:01:20.756703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:22.274872 run osmo-stp_10.42.42.5(pid=14087): stderr: | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180120927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:22.406743 run osmo-stp_10.42.42.5(pid=14087): stdout: | (launched: 2022-12-13_18:01:20.756703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:22.532078 run osmo-stp_10.42.42.5(pid=14087): stderr: | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180120926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180120927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180120927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:22.680693 run patchelf(pid=14090): Terminating (SIGINT) 18:01:22.855923 run patchelf(pid=14090): Terminated: ok {rc=0} 18:01:22.982811 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14087): Process ended prematurely: osmo-stp_10.42.42.5(pid=14087) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14087)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 18:01:22.992233 tst iperf3.py:8: Test FAILED (7.7 sec) 18:01:23.019838 run osmo-hlr_10.42.42.2(pid=14084): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14084)] 18:01:23.068122 run osmo-hlr_10.42.42.2(pid=14084): stdout: | (launched: 2022-12-13_18:01:19.787359) 18:01:23.118005 run osmo-hlr_10.42.42.2(pid=14084): stderr: | [0;m[1;31m20221213180119962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180119963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180119963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180119963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180119963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180119963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180119975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180119983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180119984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180119984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:23.168328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14079): Terminating (SIGTERM) 18:01:23.208696 run iperf3-srv_10.42.42.10(pid=14080): Terminating (SIGTERM) 18:01:23.248755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14083): Terminating (SIGTERM) 18:01:23.289316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14086): Terminating (SIGTERM) 18:01:23.329527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14089): Terminating (SIGTERM) 18:01:23.370136 --- ParallelTerminationStrategy: PID 14079 died... 18:01:23.389822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14079): Terminated: ok {rc=0} 18:01:23.434842 --- ParallelTerminationStrategy: PID 14080 died... 18:01:23.453986 run iperf3-srv_10.42.42.10(pid=14080): Terminated {rc=256} 18:01:23.498734 --- ParallelTerminationStrategy: PID 14083 died... 18:01:23.517850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14083): Terminated: ok {rc=0} 18:01:23.562436 --- ParallelTerminationStrategy: PID 14086 died... 18:01:23.581516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14086): Terminated: ok {rc=0} 18:01:23.626147 --- ParallelTerminationStrategy: PID 14089 died... 18:01:23.644892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14089): Terminated: ok {rc=0} 18:01:23.732429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:01:24.888456 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.900753 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:24.977774 tst iperf3m4.py: using LAC 35305 18:01:25.107035 tst iperf3m4.py: using RAC 115 18:01:25.234653 tst iperf3m4.py: using CellId 35305 18:01:25.364008 tst iperf3m4.py: using BVCI 35306 18:01:25.485086 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.496429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.507624 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.518808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.530365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.542070 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.553766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.565316 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:25.577088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:25.701453 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:25.821804 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:25.944271 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:26.063749 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:26.270337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:26.579113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14091): Launched 18:01:26.848914 run iperf3-srv_10.42.42.10(pid=14092): Launched 18:01:26.965432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:01:27.170830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:27.479090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14093): Launched 18:01:27.748024 run iperf3-srv_10.42.42.10(pid=14094): Launched 18:01:27.863063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:01:28.068325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:28.376887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14095): Launched 18:01:28.645127 run iperf3-srv_10.42.42.10(pid=14096): Launched 18:01:28.759683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:01:28.965816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:29.274439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Launched 18:01:29.542086 run iperf3-srv_10.42.42.10(pid=14098): Launched 18:01:29.658984 tst iperf3m4.py:8: start network... 18:01:29.864838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:30.340760 run create_hlr_db(pid=14099): Launched 18:01:30.466480 bus /gobi_6: Setting Powered False 18:01:31.526397 run create_hlr_db(pid=14099): Terminated: ok {rc=0} 18:01:31.963240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Launched 18:01:32.284617 run osmo-hlr_10.42.42.2(pid=14102): Launched 18:01:32.402475 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:32.934616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Launched 18:01:33.244414 run osmo-stp_10.42.42.5(pid=14105): Launched 18:01:33.360552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:33.886577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Launched 18:01:34.005349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:34.264755 run patchelf(pid=14108): Launched 18:01:34.436652 run osmo-stp_10.42.42.5(pid=14105): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] 18:01:34.566269 run osmo-stp_10.42.42.5(pid=14105): stdout: | (launched: 2022-12-13_18:01:33.187493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:34.696857 run osmo-stp_10.42.42.5(pid=14105): stderr: | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180133357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:34.828157 run osmo-stp_10.42.42.5(pid=14105): stdout: | (launched: 2022-12-13_18:01:33.187493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:34.953393 run osmo-stp_10.42.42.5(pid=14105): stderr: | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180133356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180133357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:35.102248 run patchelf(pid=14108): Terminating (SIGINT) 18:01:35.276937 run patchelf(pid=14108): Terminated: ok {rc=0} 18:01:35.402146 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14105): Process ended prematurely: osmo-stp_10.42.42.5(pid=14105) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:01:35.411540 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:01:35.439253 run osmo-hlr_10.42.42.2(pid=14102): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14102)] 18:01:35.487039 run osmo-hlr_10.42.42.2(pid=14102): stdout: | (launched: 2022-12-13_18:01:32.228478) 18:01:35.536609 run osmo-hlr_10.42.42.2(pid=14102): stderr: | [0;m[1;31m20221213180132398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180132398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180132398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180132398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180132399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180132399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180132411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180132419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180132420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180132420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:35.586577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14091): Terminating (SIGTERM) 18:01:35.626815 run iperf3-srv_10.42.42.10(pid=14092): Terminating (SIGTERM) 18:01:35.666896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14093): Terminating (SIGTERM) 18:01:35.706936 run iperf3-srv_10.42.42.10(pid=14094): Terminating (SIGTERM) 18:01:35.746823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14095): Terminating (SIGTERM) 18:01:35.786786 run iperf3-srv_10.42.42.10(pid=14096): Terminating (SIGTERM) 18:01:35.826807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Terminating (SIGTERM) 18:01:35.866725 run iperf3-srv_10.42.42.10(pid=14098): Terminating (SIGTERM) 18:01:35.906692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Terminating (SIGTERM) 18:01:35.946728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Terminating (SIGTERM) 18:01:35.986642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Terminating (SIGTERM) 18:01:36.027000 --- ParallelTerminationStrategy: PID 14091 died... 18:01:36.046263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14091): Terminated: ok {rc=0} 18:01:36.090828 --- ParallelTerminationStrategy: PID 14092 died... 18:01:36.109756 run iperf3-srv_10.42.42.10(pid=14092): Terminated {rc=256} 18:01:36.153908 --- ParallelTerminationStrategy: PID 14093 died... 18:01:36.172688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14093): Terminated: ok {rc=0} 18:01:36.216943 --- ParallelTerminationStrategy: PID 14094 died... 18:01:36.235849 run iperf3-srv_10.42.42.10(pid=14094): Terminated {rc=256} 18:01:36.280107 --- ParallelTerminationStrategy: PID 14095 died... 18:01:36.299060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14095): Terminated: ok {rc=0} 18:01:36.343235 --- ParallelTerminationStrategy: PID 14096 died... 18:01:36.362027 run iperf3-srv_10.42.42.10(pid=14096): Terminated {rc=256} 18:01:36.406228 --- ParallelTerminationStrategy: PID 14097 died... 18:01:36.425124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Terminated: ok {rc=0} 18:01:36.469571 --- ParallelTerminationStrategy: PID 14098 died... 18:01:36.488453 run iperf3-srv_10.42.42.10(pid=14098): Terminated {rc=256} 18:01:36.532631 --- ParallelTerminationStrategy: PID 14101 died... 18:01:36.551477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Terminated: ok {rc=0} 18:01:36.595866 --- ParallelTerminationStrategy: PID 14104 died... 18:01:36.614738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Terminated: ok {rc=0} 18:01:36.659131 --- ParallelTerminationStrategy: PID 14107 died... 18:01:36.678192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Terminated: ok {rc=0} 18:01:36.764765 bus /gobi_4: Setting Powered False 18:01:37.867376 bus /gobi_4: Setting Powered False 18:01:38.986433 bus /gobi_1: Setting Powered False 18:01:40.087130 bus /gobi_1: Setting Powered False 18:01:41.205491 bus /gobi_0: Setting Powered False 18:01:42.305213 bus /gobi_0: Setting Powered False 18:01:43.425125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:01:44.528758 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:44.540825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:44.618295 tst ping.py: using LAC 35306 18:01:44.744098 tst ping.py: using RAC 116 18:01:44.868787 tst ping.py: using CellId 35306 18:01:44.987093 tst ping.py: using BVCI 35307 18:01:45.096595 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.107696 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.118625 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.129479 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.140453 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.151420 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.162650 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:45.173636 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:45.291395 tst ping.py:19: start network... 18:01:45.509410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:46.033705 run create_hlr_db(pid=14109): Launched 18:01:46.191668 bus /gobi_6: Setting Powered False 18:01:47.251442 run create_hlr_db(pid=14109): Terminated: ok {rc=0} 18:01:47.697441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14111): Launched 18:01:48.022035 run osmo-hlr_10.42.42.2(pid=14112): Launched 18:01:48.143921 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:48.705112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14114): Launched 18:01:49.027387 run osmo-stp_10.42.42.5(pid=14115): Launched 18:01:49.149613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:49.705386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14117): Launched 18:01:49.829339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:50.104100 run patchelf(pid=14118): Launched 18:01:50.285231 run osmo-stp_10.42.42.5(pid=14115): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14115)] 18:01:50.422460 run osmo-stp_10.42.42.5(pid=14115): stdout: | (launched: 2022-12-13_18:01:48.967357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:50.561449 run osmo-stp_10.42.42.5(pid=14115): stderr: | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180149158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:50.700274 run osmo-stp_10.42.42.5(pid=14115): stdout: | (launched: 2022-12-13_18:01:48.967357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:50.833038 run osmo-stp_10.42.42.5(pid=14115): stderr: | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180149157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180149158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180149158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:50.990646 run patchelf(pid=14118): Terminating (SIGINT) 18:01:51.173903 run patchelf(pid=14118): Terminated: ok {rc=0} 18:01:51.305760 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14115): Process ended prematurely: osmo-stp_10.42.42.5(pid=14115) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14115)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 18:01:51.315322 tst ping.py:22: Test FAILED (6.8 sec) 18:01:51.343952 run osmo-hlr_10.42.42.2(pid=14112): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14112)] 18:01:51.395753 run osmo-hlr_10.42.42.2(pid=14112): stdout: | (launched: 2022-12-13_18:01:47.961951) 18:01:51.448663 run osmo-hlr_10.42.42.2(pid=14112): stderr: | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180148157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180148169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180148177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180148178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180148178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:51.502187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14111): Terminating (SIGTERM) 18:01:51.544743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14114): Terminating (SIGTERM) 18:01:51.587565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14117): Terminating (SIGTERM) 18:01:51.630736 --- ParallelTerminationStrategy: PID 14111 died... 18:01:51.651486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14111): Terminated: ok {rc=0} 18:01:51.698748 --- ParallelTerminationStrategy: PID 14114 died... 18:01:51.718938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14114): Terminated: ok {rc=0} 18:01:51.766090 --- ParallelTerminationStrategy: PID 14117 died... 18:01:51.786410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14117): Terminated: ok {rc=0} 18:01:51.876813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:01:52.965018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:52.977571 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:53.050744 tst ping_idle_ping.py: using LAC 35307 18:01:53.179599 tst ping_idle_ping.py: using RAC 117 18:01:53.307826 tst ping_idle_ping.py: using CellId 35307 18:01:53.440766 tst ping_idle_ping.py: using BVCI 35308 18:01:53.559688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.571200 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.582447 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.593663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.605128 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.616623 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.628368 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:53.639837 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:53.759605 tst ping_idle_ping.py:24: start network... 18:01:53.963593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:54.435468 run create_hlr_db(pid=14119): Launched 18:01:54.560654 bus /gobi_6: Setting Powered False 18:01:55.622052 run create_hlr_db(pid=14119): Terminated: ok {rc=0} 18:01:56.045994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Launched 18:01:56.348058 run osmo-hlr_10.42.42.2(pid=14122): Launched 18:01:56.462228 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:56.995064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Launched 18:01:57.297280 run osmo-stp_10.42.42.5(pid=14125): Launched 18:01:57.411373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:57.935349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14127): Launched 18:01:58.050876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:58.307092 run patchelf(pid=14128): Launched 18:01:58.475285 run osmo-stp_10.42.42.5(pid=14125): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] 18:01:58.603818 run osmo-stp_10.42.42.5(pid=14125): stdout: | (launched: 2022-12-13_18:01:57.241435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:58.734511 run osmo-stp_10.42.42.5(pid=14125): stderr: | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180157408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:58.864573 run osmo-stp_10.42.42.5(pid=14125): stdout: | (launched: 2022-12-13_18:01:57.241435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:58.988438 run osmo-stp_10.42.42.5(pid=14125): stderr: | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180157408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180157408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180157409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:59.134930 run patchelf(pid=14128): Terminating (SIGINT) 18:01:59.307077 run patchelf(pid=14128): Terminated: ok {rc=0} 18:01:59.429815 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14125): Process ended prematurely: osmo-stp_10.42.42.5(pid=14125) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:01:59.438602 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:01:59.465560 run osmo-hlr_10.42.42.2(pid=14122): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14122)] 18:01:59.513918 run osmo-hlr_10.42.42.2(pid=14122): stdout: | (launched: 2022-12-13_18:01:56.292044) 18:01:59.563757 run osmo-hlr_10.42.42.2(pid=14122): stderr: | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180156466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180156478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180156488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180156488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180156488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:59.614058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Terminating (SIGTERM) 18:01:59.654516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Terminating (SIGTERM) 18:01:59.695111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14127): Terminating (SIGTERM) 18:01:59.736005 --- ParallelTerminationStrategy: PID 14121 died... 18:01:59.755776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Terminated: ok {rc=0} 18:01:59.800754 --- ParallelTerminationStrategy: PID 14124 died... 18:01:59.820226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Terminated: ok {rc=0} 18:01:59.865348 --- ParallelTerminationStrategy: PID 14127 died... 18:01:59.884468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14127): Terminated: ok {rc=0} 18:01:59.972225 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:02:01.307791 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:01.314819 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:02:01.350752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:02:01.390394 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:02:01.478685 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:02:01.523656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:02:01.577956 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:02:02.182805 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:02:02.240010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.252874 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:02.325217 tst cs_paging_gprs_active.py: using LAC 35308 18:02:02.446159 tst cs_paging_gprs_active.py: using RAC 118 18:02:02.569069 tst cs_paging_gprs_active.py: using CellId 35308 18:02:02.691990 tst cs_paging_gprs_active.py: using BVCI 35309 18:02:02.805317 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.816300 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.827207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.838144 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.848763 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.859641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.870619 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.881467 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:02.892338 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:03.015216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:03.138284 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:02:03.345190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:03.654271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Launched 18:02:03.923748 run iperf3-srv_10.42.42.10(pid=14133): Launched 18:02:04.038649 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:02:04.243329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:04.550753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14134): Launched 18:02:04.819961 run iperf3-srv_10.42.42.10(pid=14135): Launched 18:02:04.935150 tst cs_paging_gprs_active.py:38: start network... 18:02:05.139969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:05.614894 run create_hlr_db(pid=14136): Launched 18:02:05.739662 bus /gobi_6: Setting Powered False 18:02:06.800074 run create_hlr_db(pid=14136): Terminated: ok {rc=0} 18:02:07.248231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14138): Launched 18:02:07.577409 run osmo-hlr_10.42.42.2(pid=14139): Launched 18:02:07.702649 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:08.268184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14141): Launched 18:02:08.598421 run osmo-stp_10.42.42.5(pid=14142): Launched 18:02:08.725408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:09.294481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14144): Launched 18:02:09.421497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:09.699050 run patchelf(pid=14145): Launched 18:02:09.884503 run osmo-stp_10.42.42.5(pid=14142): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14142)] 18:02:10.024337 run osmo-stp_10.42.42.5(pid=14142): stdout: | (launched: 2022-12-13_18:02:08.537584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:10.164717 run osmo-stp_10.42.42.5(pid=14142): stderr: | [0;m[38;5;43m20221213180208727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180208727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180208728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180208728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180208728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180208729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180208729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:10.305696 run osmo-stp_10.42.42.5(pid=14142): stdout: | (launched: 2022-12-13_18:02:08.537584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:10.440080 run osmo-stp_10.42.42.5(pid=14142): stderr: | [0;m[38;5;43m20221213180208727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180208727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180208728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180208728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180208728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180208729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180208729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:10.599721 run patchelf(pid=14145): Terminating (SIGINT) 18:02:10.786118 run patchelf(pid=14145): Terminated: ok {rc=0} 18:02:10.920336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14142): Process ended prematurely: osmo-stp_10.42.42.5(pid=14142) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14142)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:02:10.930581 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:02:10.959195 run osmo-hlr_10.42.42.2(pid=14139): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14139)] 18:02:11.010789 run osmo-hlr_10.42.42.2(pid=14139): stdout: | (launched: 2022-12-13_18:02:07.516699) 18:02:11.063459 run osmo-hlr_10.42.42.2(pid=14139): stderr: | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180207713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180207725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180207734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180207734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180207734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:11.116155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Terminating (SIGTERM) 18:02:11.158234 run iperf3-srv_10.42.42.10(pid=14133): Terminating (SIGTERM) 18:02:11.200546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14134): Terminating (SIGTERM) 18:02:11.243093 run iperf3-srv_10.42.42.10(pid=14135): Terminating (SIGTERM) 18:02:11.285614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14138): Terminating (SIGTERM) 18:02:11.328067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14141): Terminating (SIGTERM) 18:02:11.370390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14144): Terminating (SIGTERM) 18:02:11.412922 --- ParallelTerminationStrategy: PID 14132 died... 18:02:11.433510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Terminated: ok {rc=0} 18:02:11.480454 --- ParallelTerminationStrategy: PID 14133 died... 18:02:11.500501 run iperf3-srv_10.42.42.10(pid=14133): Terminated {rc=256} 18:02:11.547118 --- ParallelTerminationStrategy: PID 14134 died... 18:02:11.567166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14134): Terminated: ok {rc=0} 18:02:11.613815 --- ParallelTerminationStrategy: PID 14135 died... 18:02:11.634002 run iperf3-srv_10.42.42.10(pid=14135): Terminated {rc=256} 18:02:11.680391 --- ParallelTerminationStrategy: PID 14138 died... 18:02:11.700793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14138): Terminated: ok {rc=0} 18:02:11.747497 --- ParallelTerminationStrategy: PID 14141 died... 18:02:11.767454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14141): Terminated: ok {rc=0} 18:02:11.814006 --- ParallelTerminationStrategy: PID 14144 died... 18:02:11.833983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14144): Terminated: ok {rc=0} 18:02:11.922729 bus /gobi_0: Setting Powered False 18:02:13.022442 bus /gobi_0: Setting Powered False 18:02:14.138910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:02:15.290012 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.302099 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:15.374650 tst iperf3.py: using LAC 35309 18:02:15.502322 tst iperf3.py: using RAC 119 18:02:15.632014 tst iperf3.py: using CellId 35309 18:02:15.760177 tst iperf3.py: using BVCI 35310 18:02:15.885316 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.902708 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.914993 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.927351 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.939970 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.952829 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.966176 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.978964 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:15.992402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:16.119240 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:02:16.346914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:16.681473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14146): Launched 18:02:16.974344 run iperf3-srv_10.42.42.10(pid=14147): Launched 18:02:17.109428 tst iperf3.py:8: start network... 18:02:17.320113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:17.797027 run create_hlr_db(pid=14148): Launched 18:02:17.924251 bus /gobi_6: Setting Powered False 18:02:18.988717 run create_hlr_db(pid=14148): Terminated: ok {rc=0} 18:02:19.430945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14150): Launched 18:02:19.740629 run osmo-hlr_10.42.42.2(pid=14151): Launched 18:02:19.857211 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:20.391476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14153): Launched 18:02:20.698733 run osmo-stp_10.42.42.5(pid=14154): Launched 18:02:20.815147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:21.344826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14156): Launched 18:02:21.462771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:21.723014 run patchelf(pid=14157): Launched 18:02:21.894663 run osmo-stp_10.42.42.5(pid=14154): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14154)] 18:02:22.024486 run osmo-stp_10.42.42.5(pid=14154): stdout: | (launched: 2022-12-13_18:02:20.642123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:22.155940 run osmo-stp_10.42.42.5(pid=14154): stderr: | [0;m[38;5;43m20221213180220811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180220811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180220812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180220812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180220812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180220813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180220813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:22.287180 run osmo-stp_10.42.42.5(pid=14154): stdout: | (launched: 2022-12-13_18:02:20.642123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:22.412619 run osmo-stp_10.42.42.5(pid=14154): stderr: | [0;m[38;5;43m20221213180220811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180220811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180220812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180220812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180220812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180220813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180220813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:22.561138 run patchelf(pid=14157): Terminating (SIGINT) 18:02:22.736364 run patchelf(pid=14157): Terminated: ok {rc=0} 18:02:22.861981 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14154): Process ended prematurely: osmo-stp_10.42.42.5(pid=14154) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14154)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 18:02:22.871367 tst iperf3.py:8: Test FAILED (7.6 sec) 18:02:22.898729 run osmo-hlr_10.42.42.2(pid=14151): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14151)] 18:02:22.946913 run osmo-hlr_10.42.42.2(pid=14151): stdout: | (launched: 2022-12-13_18:02:19.683802) 18:02:22.996685 run osmo-hlr_10.42.42.2(pid=14151): stderr: | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180219859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180219871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180219881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180219881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180219881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:23.046761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14146): Terminating (SIGTERM) 18:02:23.087007 run iperf3-srv_10.42.42.10(pid=14147): Terminating (SIGTERM) 18:02:23.127252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14150): Terminating (SIGTERM) 18:02:23.167362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14153): Terminating (SIGTERM) 18:02:23.207455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14156): Terminating (SIGTERM) 18:02:23.247908 --- ParallelTerminationStrategy: PID 14146 died... 18:02:23.267480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14146): Terminated: ok {rc=0} 18:02:23.312331 --- ParallelTerminationStrategy: PID 14147 died... 18:02:23.331261 run iperf3-srv_10.42.42.10(pid=14147): Terminated {rc=256} 18:02:23.376241 --- ParallelTerminationStrategy: PID 14150 died... 18:02:23.395370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14150): Terminated: ok {rc=0} 18:02:23.439933 --- ParallelTerminationStrategy: PID 14153 died... 18:02:23.458913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14153): Terminated: ok {rc=0} 18:02:23.503307 --- ParallelTerminationStrategy: PID 14156 died... 18:02:23.522410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14156): Terminated: ok {rc=0} 18:02:23.608636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:02:24.757614 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.769256 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:24.840215 tst iperf3m4.py: using LAC 35310 18:02:24.961196 tst iperf3m4.py: using RAC 120 18:02:25.081490 tst iperf3m4.py: using CellId 35310 18:02:25.201698 tst iperf3m4.py: using BVCI 35311 18:02:25.312473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.323870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.334762 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.345727 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.357023 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.368022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.379101 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.389889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:25.400887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:25.516362 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:25.635599 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:25.758548 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:25.876722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:02:26.082831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:26.391211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14158): Launched 18:02:26.660573 run iperf3-srv_10.42.42.10(pid=14159): Launched 18:02:26.776655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:02:26.982783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:27.292614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14160): Launched 18:02:27.562134 run iperf3-srv_10.42.42.10(pid=14161): Launched 18:02:27.679278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:02:27.885228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:28.194383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14162): Launched 18:02:28.465113 run iperf3-srv_10.42.42.10(pid=14163): Launched 18:02:28.580578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:02:28.786702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:29.095988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Launched 18:02:29.364663 run iperf3-srv_10.42.42.10(pid=14165): Launched 18:02:29.480266 tst iperf3m4.py:8: start network... 18:02:29.685379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:30.160523 run create_hlr_db(pid=14166): Launched 18:02:30.285966 bus /gobi_6: Setting Powered False 18:02:31.364357 run create_hlr_db(pid=14166): Terminated: ok {rc=0} 18:02:31.875324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Launched 18:02:32.200177 run osmo-hlr_10.42.42.2(pid=14169): Launched 18:02:32.323398 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:32.858678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Launched 18:02:33.169526 run osmo-stp_10.42.42.5(pid=14172): Launched 18:02:33.286075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:33.818043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Launched 18:02:33.937868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:34.199062 run patchelf(pid=14175): Launched 18:02:34.370958 run osmo-stp_10.42.42.5(pid=14172): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] 18:02:34.501876 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-13_18:02:33.112231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:34.634200 run osmo-stp_10.42.42.5(pid=14172): stderr: | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180233283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:34.767075 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-13_18:02:33.112231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:34.893171 run osmo-stp_10.42.42.5(pid=14172): stderr: | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180233283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180233283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180233284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:35.042656 run patchelf(pid=14175): Terminating (SIGINT) 18:02:35.218205 run patchelf(pid=14175): Terminated: ok {rc=0} 18:02:35.343747 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:02:35.353312 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:02:35.381120 run osmo-hlr_10.42.42.2(pid=14169): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14169)] 18:02:35.429760 run osmo-hlr_10.42.42.2(pid=14169): stdout: | (launched: 2022-12-13_18:02:32.142806) 18:02:35.480795 run osmo-hlr_10.42.42.2(pid=14169): stderr: | [0;m[1;31m20221213180232327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180232327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180232327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180232327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180232328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180232328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180232339 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180232349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180232349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180232349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:35.531489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14158): Terminating (SIGTERM) 18:02:35.571931 run iperf3-srv_10.42.42.10(pid=14159): Terminating (SIGTERM) 18:02:35.612083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14160): Terminating (SIGTERM) 18:02:35.652148 run iperf3-srv_10.42.42.10(pid=14161): Terminating (SIGTERM) 18:02:35.692340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14162): Terminating (SIGTERM) 18:02:35.732530 run iperf3-srv_10.42.42.10(pid=14163): Terminating (SIGTERM) 18:02:35.772645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Terminating (SIGTERM) 18:02:35.812830 run iperf3-srv_10.42.42.10(pid=14165): Terminating (SIGTERM) 18:02:35.853045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminating (SIGTERM) 18:02:35.893366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminating (SIGTERM) 18:02:35.933540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Terminating (SIGTERM) 18:02:35.974054 --- ParallelTerminationStrategy: PID 14158 died... 18:02:35.993595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14158): Terminated: ok {rc=0} 18:02:36.038623 --- ParallelTerminationStrategy: PID 14159 died... 18:02:36.057371 run iperf3-srv_10.42.42.10(pid=14159): Terminated {rc=256} 18:02:36.101991 --- ParallelTerminationStrategy: PID 14160 died... 18:02:36.121097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14160): Terminated: ok {rc=0} 18:02:36.165475 --- ParallelTerminationStrategy: PID 14161 died... 18:02:36.184509 run iperf3-srv_10.42.42.10(pid=14161): Terminated {rc=256} 18:02:36.228648 --- ParallelTerminationStrategy: PID 14162 died... 18:02:36.247634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14162): Terminated: ok {rc=0} 18:02:36.292030 --- ParallelTerminationStrategy: PID 14163 died... 18:02:36.311043 run iperf3-srv_10.42.42.10(pid=14163): Terminated {rc=256} 18:02:36.355396 --- ParallelTerminationStrategy: PID 14164 died... 18:02:36.374397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Terminated: ok {rc=0} 18:02:36.418952 --- ParallelTerminationStrategy: PID 14165 died... 18:02:36.437949 run iperf3-srv_10.42.42.10(pid=14165): Terminated {rc=256} 18:02:36.482282 --- ParallelTerminationStrategy: PID 14168 died... 18:02:36.501231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminated: ok {rc=0} 18:02:36.545583 --- ParallelTerminationStrategy: PID 14171 died... 18:02:36.564309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminated: ok {rc=0} 18:02:36.608906 --- ParallelTerminationStrategy: PID 14174 died... 18:02:36.628000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Terminated: ok {rc=0} 18:02:36.712779 bus /gobi_4: Setting Powered False 18:02:37.810073 bus /gobi_4: Setting Powered False 18:02:38.926428 bus /gobi_1: Setting Powered False 18:02:40.026195 bus /gobi_1: Setting Powered False 18:02:41.143778 bus /gobi_0: Setting Powered False 18:02:42.244101 bus /gobi_0: Setting Powered False 18:02:43.362130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:02:44.466869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:44.478447 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:44.548109 tst ping.py: using LAC 35311 18:02:44.668872 tst ping.py: using RAC 121 18:02:44.801209 tst ping.py: using CellId 35311 18:02:44.930634 tst ping.py: using BVCI 35312 18:02:45.050678 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.062438 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.073832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.085188 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.096630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.108106 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.119709 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:45.131296 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:45.248503 tst ping.py:19: start network... 18:02:45.452219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:45.937633 run create_hlr_db(pid=14177): Launched 18:02:46.086630 bus /gobi_6: Setting Powered False 18:02:47.158403 run create_hlr_db(pid=14177): Terminated: ok {rc=0} 18:02:47.618506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14179): Launched 18:02:47.946203 run osmo-hlr_10.42.42.2(pid=14180): Launched 18:02:48.072772 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:48.636128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14182): Launched 18:02:48.962173 run osmo-stp_10.42.42.5(pid=14183): Launched 18:02:49.087723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:49.650709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14185): Launched 18:02:49.775431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:50.052498 run patchelf(pid=14186): Launched 18:02:50.233717 run osmo-stp_10.42.42.5(pid=14183): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14183)] 18:02:50.371888 run osmo-stp_10.42.42.5(pid=14183): stdout: | (launched: 2022-12-13_18:02:48.901948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:50.511763 run osmo-stp_10.42.42.5(pid=14183): stderr: | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180249092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:50.651852 run osmo-stp_10.42.42.5(pid=14183): stdout: | (launched: 2022-12-13_18:02:48.901948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:50.785505 run osmo-stp_10.42.42.5(pid=14183): stderr: | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180249092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180249092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180249093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:50.943714 run patchelf(pid=14186): Terminating (SIGINT) 18:02:51.128809 run patchelf(pid=14186): Terminated: ok {rc=0} 18:02:51.261638 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14183): Process ended prematurely: osmo-stp_10.42.42.5(pid=14183) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14183)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 18:02:51.271299 tst ping.py:22: Test FAILED (6.8 sec) 18:02:51.299898 run osmo-hlr_10.42.42.2(pid=14180): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14180)] 18:02:51.351634 run osmo-hlr_10.42.42.2(pid=14180): stdout: | (launched: 2022-12-13_18:02:47.886120) 18:02:51.404595 run osmo-hlr_10.42.42.2(pid=14180): stderr: | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180248083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180248095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180248106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180248106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180248106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:51.458122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14179): Terminating (SIGTERM) 18:02:51.500559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14182): Terminating (SIGTERM) 18:02:51.543869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14185): Terminating (SIGTERM) 18:02:51.587121 --- ParallelTerminationStrategy: PID 14179 died... 18:02:51.608163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14179): Terminated: ok {rc=0} 18:02:51.655633 --- ParallelTerminationStrategy: PID 14182 died... 18:02:51.676025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14182): Terminated: ok {rc=0} 18:02:51.723219 --- ParallelTerminationStrategy: PID 14185 died... 18:02:51.743381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14185): Terminated: ok {rc=0} 18:02:51.832163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:02:52.922508 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:52.934818 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:53.009300 tst ping_idle_ping.py: using LAC 35312 18:02:53.137807 tst ping_idle_ping.py: using RAC 122 18:02:53.263855 tst ping_idle_ping.py: using CellId 35312 18:02:53.392070 tst ping_idle_ping.py: using BVCI 35313 18:02:53.511872 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.523511 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.534677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.545974 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.557586 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.569258 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.581116 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:53.592772 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:53.711283 tst ping_idle_ping.py:24: start network... 18:02:53.915177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:54.390058 run create_hlr_db(pid=14187): Launched 18:02:54.516740 bus /gobi_6: Setting Powered False 18:02:55.578431 run create_hlr_db(pid=14187): Terminated: ok {rc=0} 18:02:56.006474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Launched 18:02:56.312836 run osmo-hlr_10.42.42.2(pid=14190): Launched 18:02:56.427208 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:56.965430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Launched 18:02:57.271228 run osmo-stp_10.42.42.5(pid=14193): Launched 18:02:57.386622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:57.912090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Launched 18:02:58.029414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:58.286514 run patchelf(pid=14196): Launched 18:02:58.456493 run osmo-stp_10.42.42.5(pid=14193): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] 18:02:58.584571 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-13_18:02:57.214601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:58.715201 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180257383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:58.845604 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-13_18:02:57.214601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:58.969567 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180257382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180257383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180257383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:59.116645 run patchelf(pid=14196): Terminating (SIGINT) 18:02:59.289436 run patchelf(pid=14196): Terminated: ok {rc=0} 18:02:59.413123 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:02:59.422146 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:02:59.449255 run osmo-hlr_10.42.42.2(pid=14190): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14190)] 18:02:59.497431 run osmo-hlr_10.42.42.2(pid=14190): stdout: | (launched: 2022-12-13_18:02:56.256250) 18:02:59.547168 run osmo-hlr_10.42.42.2(pid=14190): stderr: | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180256432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180256444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180256454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180256454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180256454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:59.597696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminating (SIGTERM) 18:02:59.638487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminating (SIGTERM) 18:02:59.678980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminating (SIGTERM) 18:02:59.719651 --- ParallelTerminationStrategy: PID 14189 died... 18:02:59.738687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminated: ok {rc=0} 18:02:59.783460 --- ParallelTerminationStrategy: PID 14192 died... 18:02:59.802515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminated: ok {rc=0} 18:02:59.847019 --- ParallelTerminationStrategy: PID 14195 died... 18:02:59.866047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminated: ok {rc=0} 18:02:59.953225 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:03:01.298158 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:01.305432 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:03:01.340689 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:03:01.377590 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:03:01.436834 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:03:01.483224 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:03:01.521689 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:03:02.098982 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:03:02.107515 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.123209 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:03:02.209057 tst switch_tch_pdch.py: using LAC 35313 18:03:02.330710 tst switch_tch_pdch.py: using RAC 123 18:03:02.452461 tst switch_tch_pdch.py: using CellId 35313 18:03:02.576567 tst switch_tch_pdch.py: using BVCI 35314 18:03:02.689198 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.700433 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.711551 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.722583 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.734331 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.745922 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.757448 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:03:02.768890 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:03:02.891893 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:03:03.017955 tst switch_tch_pdch.py:51: start network... 18:03:03.222446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:03.693719 run create_hlr_db(pid=14202): Launched 18:03:03.818317 bus /gobi_6: Setting Powered False 18:03:04.879190 run create_hlr_db(pid=14202): Terminated: ok {rc=0} 18:03:05.303319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14204): Launched 18:03:05.607353 run osmo-hlr_10.42.42.2(pid=14205): Launched 18:03:05.724903 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:06.251301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14207): Launched 18:03:06.556108 run osmo-stp_10.42.42.5(pid=14208): Launched 18:03:06.671292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:03:07.193997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14210): Launched 18:03:07.310772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:03:07.567670 run patchelf(pid=14211): Launched 18:03:07.737210 run osmo-stp_10.42.42.5(pid=14208): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14208)] 18:03:07.865509 run osmo-stp_10.42.42.5(pid=14208): stdout: | (launched: 2022-12-13_18:03:06.499699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:07.995569 run osmo-stp_10.42.42.5(pid=14208): stderr: | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180306669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:08.126178 run osmo-stp_10.42.42.5(pid=14208): stdout: | (launched: 2022-12-13_18:03:06.499699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:08.249824 run osmo-stp_10.42.42.5(pid=14208): stderr: | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180306668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180306669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180306670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:08.396895 run patchelf(pid=14211): Terminating (SIGINT) 18:03:08.568831 run patchelf(pid=14211): Terminated: ok {rc=0} 18:03:08.692317 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14208): Process ended prematurely: osmo-stp_10.42.42.5(pid=14208) [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14208)] [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:03:08.701366 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:03:08.728274 run osmo-hlr_10.42.42.2(pid=14205): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14205)] 18:03:08.776065 run osmo-hlr_10.42.42.2(pid=14205): stdout: | (launched: 2022-12-13_18:03:05.550883) 18:03:08.825923 run osmo-hlr_10.42.42.2(pid=14205): stderr: | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180305728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180305740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180305749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180305750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180305750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:08.876035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14204): Terminating (SIGTERM) 18:03:08.916023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14207): Terminating (SIGTERM) 18:03:08.956039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14210): Terminating (SIGTERM) 18:03:08.996316 --- ParallelTerminationStrategy: PID 14204 died... 18:03:09.015857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14204): Terminated: ok {rc=0} 18:03:09.060250 --- ParallelTerminationStrategy: PID 14207 died... 18:03:09.079325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14207): Terminated: ok {rc=0} 18:03:09.123770 --- ParallelTerminationStrategy: PID 14210 died... 18:03:09.142830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14210): Terminated: ok {rc=0} 18:03:09.230028 bus /gobi_0: Setting Powered False 18:03:10.333112 bus /gobi_0: Setting Powered False 18:03:11.451912 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:03:12.708554 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:12.715155 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:03:12.750190 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:03:12.786153 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:03:12.840644 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:03:12.874910 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:03:12.910956 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:03:13.466902 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:03:13.472686 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:13.484374 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:03:13.555727 tst switch_tch_pdch.py: using LAC 35314 18:03:13.684554 tst switch_tch_pdch.py: using RAC 124 18:03:13.811964 tst switch_tch_pdch.py: using CellId 35314 18:03:13.939112 tst switch_tch_pdch.py: using BVCI 35315 18:03:14.059335 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.070948 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.082372 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.093702 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.105359 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.117057 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.129151 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:03:14.140805 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:03:14.258468 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:03:14.375279 tst switch_tch_pdch.py:51: start network... 18:03:14.579772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:15.025061 run create_hlr_db(pid=14215): Launched 18:03:15.149456 bus /gobi_6: Setting Powered False 18:03:16.208892 run create_hlr_db(pid=14215): Terminated: ok {rc=0} 18:03:16.613119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Launched 18:03:16.932396 run osmo-hlr_10.42.42.2(pid=14218): Launched 18:03:17.167951 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:17.720834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Launched 18:03:18.048190 run osmo-stp_10.42.42.5(pid=14221): Launched 18:03:18.173413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:03:18.704162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14223): Launched 18:03:18.830294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:03:19.106591 run patchelf(pid=14224): Launched 18:03:19.288544 run osmo-stp_10.42.42.5(pid=14221): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] 18:03:19.426806 run osmo-stp_10.42.42.5(pid=14221): stdout: | (launched: 2022-12-13_18:03:17.988013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:19.567257 run osmo-stp_10.42.42.5(pid=14221): stderr: | [0;m[38;5;43m20221213180318177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180318177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180318178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180318178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:19.707823 run osmo-stp_10.42.42.5(pid=14221): stdout: | (launched: 2022-12-13_18:03:17.988013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:19.842029 run osmo-stp_10.42.42.5(pid=14221): stderr: | [0;m[38;5;43m20221213180318177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180318177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180318178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180318178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180318179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:20.000454 run patchelf(pid=14224): Terminating (SIGINT) 18:03:20.186285 run patchelf(pid=14224): Terminated: ok {rc=0} 18:03:20.319808 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14221): Process ended prematurely: osmo-stp_10.42.42.5(pid=14221) [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:03:20.329782 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:03:20.358049 run osmo-hlr_10.42.42.2(pid=14218): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14218)] 18:03:20.409828 run osmo-hlr_10.42.42.2(pid=14218): stdout: | (launched: 2022-12-13_18:03:16.875435) 18:03:20.462670 run osmo-hlr_10.42.42.2(pid=14218): stderr: | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180317125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180317142 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180317164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180317164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180317164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:20.516602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Terminating (SIGTERM) 18:03:20.559092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Terminating (SIGTERM) 18:03:20.601802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14223): Terminating (SIGTERM) 18:03:20.645094 --- ParallelTerminationStrategy: PID 14217 died... 18:03:20.665900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Terminated: ok {rc=0} 18:03:20.713405 --- ParallelTerminationStrategy: PID 14220 died... 18:03:20.733841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Terminated: ok {rc=0} 18:03:20.780934 --- ParallelTerminationStrategy: PID 14223 died... 18:03:20.801570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14223): Terminated: ok {rc=0} 18:03:20.890786 bus /gobi_0: Setting Powered False 18:03:21.991187 bus /gobi_0: Setting Powered False 18:03:23.110061 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:24.362266 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:24.367080 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:24.395941 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:03:24.402814 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:03:24.455199 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:24.486021 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:03:24.493276 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:03:25.028820 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:03:25.034098 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:03:25.045080 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:25.088612 tst mo_mt_sms.py: using LAC 35315 18:03:25.216434 tst mo_mt_sms.py: using RAC 125 18:03:25.343402 tst mo_mt_sms.py: using CellId 35315 18:03:25.475070 tst mo_mt_sms.py: using BVCI 35316 18:03:25.594491 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:25.711641 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:25.831865 tst mo_mt_sms.py:9: start nitb and bts... 18:03:26.054313 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:03:26.713708 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14228): Launched 18:03:27.039884 run osmo-nitb_10.42.42.2(pid=14229): Launched 18:03:27.219773 run osmo-nitb_10.42.42.2(pid=14229): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14229)] 18:03:27.366040 run osmo-nitb_10.42.42.2(pid=14229): stdout: | (launched: 2022-12-13_18:03:26.979769) 18:03:27.513144 run osmo-nitb_10.42.42.2(pid=14229): stderr: | (launched: 2022-12-13_18:03:27.028365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:27.660425 run osmo-nitb_10.42.42.2(pid=14229): stdout: | (launched: 2022-12-13_18:03:26.979769) 18:03:27.801436 run osmo-nitb_10.42.42.2(pid=14229): stderr: | (launched: 2022-12-13_18:03:27.028365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14229): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14229) [trial-2392↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14229)] 18:03:28.162104 tst osmo-nitb_10.42.42.2(pid=14229): stdout: | (launched: 2022-12-13_18:03:26.979769) 18:03:28.294155 tst osmo-nitb_10.42.42.2(pid=14229): stderr: | (launched: 2022-12-13_18:03:27.028365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:28.449514 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14229): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14229) [trial-2392↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14229)] [trial-2392↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 18:03:28.458830 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:03:28.466243 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14228): Terminating (SIGTERM) 18:03:28.677828 --- ParallelTerminationStrategy: PID 14228 died... 18:03:28.700820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14228): Terminated: ok {rc=0} 18:03:28.790414 bus /sierra_3: Setting Powered False 18:03:29.892091 bus /sierra_3: Setting Powered False 18:03:31.019744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:32.231747 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:32.236548 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:32.266544 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:03:32.293039 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:03:32.352860 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:32.383591 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:03:32.410112 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:03:32.951143 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:03:32.956771 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:32.968219 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:33.013460 tst mo_mt_sms.py: using LAC 35316 18:03:33.141200 tst mo_mt_sms.py: using RAC 126 18:03:33.267670 tst mo_mt_sms.py: using CellId 35316 18:03:33.386606 tst mo_mt_sms.py: using BVCI 35317 18:03:33.496458 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:33.507354 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:33.518256 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:33.528874 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:33.539792 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:33.550317 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:33.672005 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:33.789710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:34.258360 run create_hlr_db(pid=14233): Launched 18:03:34.382631 bus /sierra_2: Setting Powered False 18:03:35.443182 run create_hlr_db(pid=14233): Terminated: ok {rc=0} 18:03:35.875634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Launched 18:03:36.179298 run osmo-hlr_10.42.42.2(pid=14236): Launched 18:03:36.293515 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:36.813740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Launched 18:03:37.116360 run osmo-stp_10.42.42.5(pid=14239): Launched 18:03:37.231105 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:37.782572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Launched 18:03:38.088136 run osmo-msc_10.42.42.6(pid=14242): Launched 18:03:38.257627 run osmo-stp_10.42.42.5(pid=14239): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] 18:03:38.385917 run osmo-stp_10.42.42.5(pid=14239): stdout: | (launched: 2022-12-13_18:03:37.059963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:38.514423 run osmo-stp_10.42.42.5(pid=14239): stderr: | [0;m[38;5;43m20221213180337229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180337229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180337230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180337230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180337230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180337231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180337231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:38.640642 run osmo-stp_10.42.42.5(pid=14239): stdout: | (launched: 2022-12-13_18:03:37.059963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:38.761447 run osmo-stp_10.42.42.5(pid=14239): stderr: | [0;m[38;5;43m20221213180337229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180337229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180337230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180337230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180337230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180337231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180337231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:38.905972 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14239): Process ended prematurely: osmo-stp_10.42.42.5(pid=14239) [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 18:03:38.914539 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 18:03:38.941155 run osmo-hlr_10.42.42.2(pid=14236): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14236)] 18:03:38.989949 run osmo-hlr_10.42.42.2(pid=14236): stdout: | (launched: 2022-12-13_18:03:36.122957) 18:03:39.040285 run osmo-hlr_10.42.42.2(pid=14236): stderr: | [0;m[1;31m20221213180336297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180336298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180336298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180336298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180336298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180336298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180336314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180336324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180336325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180336325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:39.110848 run osmo-msc_10.42.42.6(pid=14242): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14242)] 18:03:39.159584 run osmo-msc_10.42.42.6(pid=14242): stdout: | (launched: 2022-12-13_18:03:38.031658) 18:03:39.210071 run osmo-msc_10.42.42.6(pid=14242): stderr: | [0;m[38;5;43m20221213180338302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180338302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4aad47dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180338303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180338303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180338303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180338303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180338305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180338305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180338305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180338306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:39.260783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Terminating (SIGTERM) 18:03:39.301206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Terminating (SIGTERM) 18:03:39.341577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Terminating (SIGTERM) 18:03:39.382362 --- ParallelTerminationStrategy: PID 14235 died... 18:03:39.402402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Terminated: ok {rc=0} 18:03:39.447372 --- ParallelTerminationStrategy: PID 14238 died... 18:03:39.466616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Terminated: ok {rc=0} 18:03:39.511567 --- ParallelTerminationStrategy: PID 14241 died... 18:03:39.530593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Terminated: ok {rc=0} 18:03:39.616379 bus /sierra_3: Setting Powered False 18:03:40.713433 bus /sierra_3: Setting Powered False 18:03:41.832160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:43.066777 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:43.071852 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:43.102093 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:03:43.110441 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:43.147141 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:43.176642 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:03:43.183505 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:43.704800 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:43.710545 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:03:43.722080 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:43.767714 tst assert_extension.py: using LAC 35317 18:03:43.887821 tst assert_extension.py: using RAC 127 18:03:44.005340 tst assert_extension.py: using CellId 35317 18:03:44.123123 tst assert_extension.py: using BVCI 35318 18:03:44.234216 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:44.353910 tst assert_extension.py:10: start nitb and bts... 18:03:44.574392 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:03:45.238706 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Launched 18:03:45.565687 run osmo-nitb_10.42.42.2(pid=14249): Launched 18:03:45.747587 run osmo-nitb_10.42.42.2(pid=14249): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] 18:03:45.920349 run osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-13_18:03:45.505569) 18:03:46.063852 run osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-13_18:03:45.553744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:46.204733 run osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-13_18:03:45.505569) 18:03:46.342148 run osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-13_18:03:45.553744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2392↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] 18:03:46.690014 tst osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-13_18:03:45.505569) 18:03:46.816088 tst osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-13_18:03:45.553744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:46.964807 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2392↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] [trial-2392↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 18:03:46.974345 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:03:46.981958 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Terminating (SIGTERM) 18:03:47.194628 --- ParallelTerminationStrategy: PID 14248 died... 18:03:47.215428 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Terminated: ok {rc=0} 18:03:47.304107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:48.483747 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:48.488230 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:48.518190 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:03:48.547193 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:48.583546 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:48.614672 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:03:48.642686 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:49.172341 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:49.177982 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.189374 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:49.236336 tst assert_extension.py: using LAC 35318 18:03:49.363571 tst assert_extension.py: using RAC 128 18:03:49.490932 tst assert_extension.py: using CellId 35318 18:03:49.619239 tst assert_extension.py: using BVCI 35319 18:03:49.737557 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.749025 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.760413 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.771694 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.783290 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:49.794868 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:49.913176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:50.383803 run create_hlr_db(pid=14253): Launched 18:03:50.507267 bus /sierra_2: Setting Powered False 18:03:51.567834 run create_hlr_db(pid=14253): Terminated: ok {rc=0} 18:03:52.013206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Launched 18:03:52.341408 run osmo-hlr_10.42.42.2(pid=14256): Launched 18:03:52.466719 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:53.033447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Launched 18:03:53.361992 run osmo-stp_10.42.42.5(pid=14259): Launched 18:03:53.487428 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:54.077051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Launched 18:03:54.403073 run osmo-msc_10.42.42.6(pid=14262): Launched 18:03:54.585304 run osmo-stp_10.42.42.5(pid=14259): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] 18:03:54.722040 run osmo-stp_10.42.42.5(pid=14259): stdout: | (launched: 2022-12-13_18:03:53.301474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:54.859087 run osmo-stp_10.42.42.5(pid=14259): stderr: | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180353494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:54.995470 run osmo-stp_10.42.42.5(pid=14259): stdout: | (launched: 2022-12-13_18:03:53.301474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:55.125619 run osmo-stp_10.42.42.5(pid=14259): stderr: | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180353494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180353494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:55.281012 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14259): Process ended prematurely: osmo-stp_10.42.42.5(pid=14259) [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 18:03:55.290293 tst assert_extension.py:17: Test FAILED (6.1 sec) 18:03:55.318514 run osmo-hlr_10.42.42.2(pid=14256): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14256)] 18:03:55.370585 run osmo-hlr_10.42.42.2(pid=14256): stdout: | (launched: 2022-12-13_18:03:52.281137) 18:03:55.424282 run osmo-hlr_10.42.42.2(pid=14256): stderr: | [0;m[1;31m20221213180352477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180352477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180352477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180352477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180352478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180352478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180352490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180352499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180352499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180352499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:55.498373 run osmo-msc_10.42.42.6(pid=14262): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14262)] 18:03:55.549195 run osmo-msc_10.42.42.6(pid=14262): stdout: | (launched: 2022-12-13_18:03:54.343112) 18:03:55.603016 run osmo-msc_10.42.42.6(pid=14262): stderr: | [0;m[38;5;43m20221213180354664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180354665 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5424d68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180354665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180354665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180354665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180354665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180354667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180354667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180354667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180354668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:55.656827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Terminating (SIGTERM) 18:03:55.699700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Terminating (SIGTERM) 18:03:55.743126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Terminating (SIGTERM) 18:03:55.786708 --- ParallelTerminationStrategy: PID 14255 died... 18:03:55.807919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Terminated: ok {rc=0} 18:03:55.855795 --- ParallelTerminationStrategy: PID 14258 died... 18:03:55.876463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Terminated: ok {rc=0} 18:03:55.923900 --- ParallelTerminationStrategy: PID 14261 died... 18:03:55.944643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Terminated: ok {rc=0} 18:03:56.035089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:03:57.247936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:57.255945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:03:57.285301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:03:57.312250 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:03:57.364333 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:03:57.394793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:03:57.423033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:03:57.974651 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:03:58.030687 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.043077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:03:58.111887 tst mo_mt_call.py: using LAC 35319 18:03:58.243959 tst mo_mt_call.py: using RAC 129 18:03:58.375682 tst mo_mt_call.py: using CellId 35319 18:03:58.499997 tst mo_mt_call.py: using BVCI 35320 18:03:58.613912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.625476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.636741 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.647999 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.659532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:58.670775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:58.794494 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:58.914813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:59.396058 run create_hlr_db(pid=14267): Launched 18:03:59.522239 bus /sierra_2: Setting Powered False 18:04:00.583798 run create_hlr_db(pid=14267): Terminated: ok {rc=0} 18:04:01.042207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14269): Launched 18:04:01.400241 run osmo-hlr_10.42.42.2(pid=14270): Launched 18:04:01.688289 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:02.473468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14272): Launched 18:04:02.786804 run osmo-stp_10.42.42.5(pid=14273): Launched 18:04:02.903980 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:03.462028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14275): Launched 18:04:03.774681 run osmo-msc_10.42.42.6(pid=14276): Launched 18:04:03.948743 run osmo-stp_10.42.42.5(pid=14273): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14273)] 18:04:04.078920 run osmo-stp_10.42.42.5(pid=14273): stdout: | (launched: 2022-12-13_18:04:02.728331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:04.210554 run osmo-stp_10.42.42.5(pid=14273): stderr: | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180402901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:04.339070 run osmo-stp_10.42.42.5(pid=14273): stdout: | (launched: 2022-12-13_18:04:02.728331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:04.461660 run osmo-stp_10.42.42.5(pid=14273): stderr: | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180402901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180402902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:04.608384 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14273): Process ended prematurely: osmo-stp_10.42.42.5(pid=14273) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14273)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:04:04.617664 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:04:04.644421 run osmo-hlr_10.42.42.2(pid=14270): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14270)] 18:04:04.692715 run osmo-hlr_10.42.42.2(pid=14270): stdout: | (launched: 2022-12-13_18:04:01.331948) 18:04:04.742823 run osmo-hlr_10.42.42.2(pid=14270): stderr: | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180401657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180401681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180401702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180401702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180401702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:04.812905 run osmo-msc_10.42.42.6(pid=14276): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14276)] 18:04:04.860892 run osmo-msc_10.42.42.6(pid=14276): stdout: | (launched: 2022-12-13_18:04:03.716850) 18:04:04.910388 run osmo-msc_10.42.42.6(pid=14276): stderr: | [0;m[38;5;43m20221213180403989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180403989 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0367aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180403989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180403989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180403989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180403989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180403991 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180403991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180403992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180403992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:04.960016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14269): Terminating (SIGTERM) 18:04:04.999897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14272): Terminating (SIGTERM) 18:04:05.040064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14275): Terminating (SIGTERM) 18:04:05.080489 --- ParallelTerminationStrategy: PID 14269 died... 18:04:05.100184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14269): Terminated: ok {rc=0} 18:04:05.144549 --- ParallelTerminationStrategy: PID 14272 died... 18:04:05.163794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14272): Terminated: ok {rc=0} 18:04:05.208194 --- ParallelTerminationStrategy: PID 14275 died... 18:04:05.227363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14275): Terminated: ok {rc=0} 18:04:05.316085 bus /sierra_3: Setting Powered False 18:04:06.417519 bus /sierra_3: Setting Powered False 18:04:07.533431 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:04:08.682465 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:08.694694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:04:08.761235 tst mo_mt_call_osmux.py: using LAC 35320 18:04:08.882546 tst mo_mt_call_osmux.py: using RAC 130 18:04:09.005412 tst mo_mt_call_osmux.py: using CellId 35320 18:04:09.126669 tst mo_mt_call_osmux.py: using BVCI 35321 18:04:09.240524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:09.251913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:09.263111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:09.274210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:09.285363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:04:09.296451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:04:09.420863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:04:09.542016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:10.022138 run create_hlr_db(pid=14278): Launched 18:04:10.149509 bus /sierra_2: Setting Powered False 18:04:11.211339 run create_hlr_db(pid=14278): Terminated: ok {rc=0} 18:04:11.665323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Launched 18:04:11.978106 run osmo-hlr_10.42.42.2(pid=14281): Launched 18:04:12.097213 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:12.629736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Launched 18:04:12.942650 run osmo-stp_10.42.42.5(pid=14284): Launched 18:04:13.062385 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:13.625332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Launched 18:04:13.936540 run osmo-msc_10.42.42.6(pid=14287): Launched 18:04:14.109200 run osmo-stp_10.42.42.5(pid=14284): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] 18:04:14.240245 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-13_18:04:12.884701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:14.371006 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221213180413053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180413053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180413054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180413054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180413054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180413054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180413055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:14.500036 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-13_18:04:12.884701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:14.622898 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221213180413053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180413053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180413054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180413054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180413054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180413054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180413055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:14.770018 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:04:14.779134 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:04:14.806434 run osmo-hlr_10.42.42.2(pid=14281): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14281)] 18:04:14.855679 run osmo-hlr_10.42.42.2(pid=14281): stdout: | (launched: 2022-12-13_18:04:11.920211) 18:04:14.906225 run osmo-hlr_10.42.42.2(pid=14281): stderr: | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180412096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180412108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180412118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180412118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180412118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:14.977045 run osmo-msc_10.42.42.6(pid=14287): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14287)] 18:04:15.025623 run osmo-msc_10.42.42.6(pid=14287): stdout: | (launched: 2022-12-13_18:04:13.878819) 18:04:15.075907 run osmo-msc_10.42.42.6(pid=14287): stderr: | [0;m[38;5;43m20221213180414152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180414152 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbab0353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180414152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180414152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180414152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180414152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180414154 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180414154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180414155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180414155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:15.126668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminating (SIGTERM) 18:04:15.167349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminating (SIGTERM) 18:04:15.208119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminating (SIGTERM) 18:04:15.249624 --- ParallelTerminationStrategy: PID 14280 died... 18:04:15.269571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminated: ok {rc=0} 18:04:15.314719 --- ParallelTerminationStrategy: PID 14283 died... 18:04:15.334140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminated: ok {rc=0} 18:04:15.379285 --- ParallelTerminationStrategy: PID 14286 died... 18:04:15.398676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminated: ok {rc=0} 18:04:15.484870 bus /sierra_3: Setting Powered False 18:04:16.581158 bus /sierra_3: Setting Powered False 18:04:17.697116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:04:18.950336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:18.958154 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:04:18.987103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:04:19.014144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:04:19.065395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:04:19.094824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:04:19.122036 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:04:19.674016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:04:19.730571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:19.742665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:04:19.810738 tst mo_mt_call.py: using LAC 35321 18:04:19.941108 tst mo_mt_call.py: using RAC 131 18:04:20.071196 tst mo_mt_call.py: using CellId 35321 18:04:20.202902 tst mo_mt_call.py: using BVCI 35322 18:04:20.325693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:20.337610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:20.349231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:20.360732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:20.372882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:20.385144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:20.506200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:20.630039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:21.144936 run create_hlr_db(pid=14292): Launched 18:04:21.271188 bus /sierra_2: Setting Powered False 18:04:22.337540 run create_hlr_db(pid=14292): Terminated: ok {rc=0} 18:04:22.801427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Launched 18:04:23.136853 run osmo-hlr_10.42.42.2(pid=14295): Launched 18:04:23.265563 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:23.842416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Launched 18:04:24.176143 run osmo-stp_10.42.42.5(pid=14298): Launched 18:04:24.304389 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:24.905893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Launched 18:04:25.241358 run osmo-msc_10.42.42.6(pid=14301): Launched 18:04:25.427814 run osmo-stp_10.42.42.5(pid=14298): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] 18:04:25.567839 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-13_18:04:24.115024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:25.708767 run osmo-stp_10.42.42.5(pid=14298): stderr: | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180424308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:25.847870 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-13_18:04:24.115024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:25.980157 run osmo-stp_10.42.42.5(pid=14298): stderr: | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180424307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180424308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180424308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:26.138960 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:04:26.148817 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:04:26.177490 run osmo-hlr_10.42.42.2(pid=14295): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14295)] 18:04:26.229903 run osmo-hlr_10.42.42.2(pid=14295): stdout: | (launched: 2022-12-13_18:04:23.075215) 18:04:26.282993 run osmo-hlr_10.42.42.2(pid=14295): stderr: | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180423274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180423287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180423295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180423296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180423296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:26.357687 run osmo-msc_10.42.42.6(pid=14301): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14301)] 18:04:26.408682 run osmo-msc_10.42.42.6(pid=14301): stdout: | (launched: 2022-12-13_18:04:25.179897) 18:04:26.462151 run osmo-msc_10.42.42.6(pid=14301): stderr: | [0;m[38;5;43m20221213180425502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180425502 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc98bcd0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180425502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180425502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180425503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180425503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180425504 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180425505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180425505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180425505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:26.515460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Terminating (SIGTERM) 18:04:26.558119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Terminating (SIGTERM) 18:04:26.601475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminating (SIGTERM) 18:04:26.644823 --- ParallelTerminationStrategy: PID 14294 died... 18:04:26.666023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Terminated: ok {rc=0} 18:04:26.713997 --- ParallelTerminationStrategy: PID 14297 died... 18:04:26.734506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Terminated: ok {rc=0} 18:04:26.781902 --- ParallelTerminationStrategy: PID 14300 died... 18:04:26.802321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminated: ok {rc=0} 18:04:26.891993 bus /sierra_3: Setting Powered False 18:04:27.991981 bus /sierra_3: Setting Powered False 18:04:29.110377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:04:30.262587 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.276172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:04:30.345208 tst mo_mt_call_osmux.py: using LAC 35322 18:04:30.474663 tst mo_mt_call_osmux.py: using RAC 132 18:04:30.605377 tst mo_mt_call_osmux.py: using CellId 35322 18:04:30.734541 tst mo_mt_call_osmux.py: using BVCI 35323 18:04:30.864358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.878131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.898639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.911228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.923723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:30.935994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:31.075365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:31.207318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:31.728433 run create_hlr_db(pid=14303): Launched 18:04:31.903185 bus /sierra_2: Setting Powered False 18:04:32.969218 run create_hlr_db(pid=14303): Terminated: ok {rc=0} 18:04:33.478611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Launched 18:04:33.812344 run osmo-hlr_10.42.42.2(pid=14306): Launched 18:04:33.941512 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:34.518297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Launched 18:04:34.851650 run osmo-stp_10.42.42.5(pid=14309): Launched 18:04:34.979235 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:35.582382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Launched 18:04:35.916270 run osmo-msc_10.42.42.6(pid=14312): Launched 18:04:36.102420 run osmo-stp_10.42.42.5(pid=14309): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] 18:04:36.243520 run osmo-stp_10.42.42.5(pid=14309): stdout: | (launched: 2022-12-13_18:04:34.790334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:36.385151 run osmo-stp_10.42.42.5(pid=14309): stderr: | [0;m[38;5;43m20221213180434982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180434982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180434983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180434983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:36.524854 run osmo-stp_10.42.42.5(pid=14309): stdout: | (launched: 2022-12-13_18:04:34.790334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:36.657796 run osmo-stp_10.42.42.5(pid=14309): stderr: | [0;m[38;5;43m20221213180434982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180434982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180434983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180434983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180434984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:36.816763 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14309): Process ended prematurely: osmo-stp_10.42.42.5(pid=14309) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:04:36.826826 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:04:36.855552 run osmo-hlr_10.42.42.2(pid=14306): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14306)] 18:04:36.907807 run osmo-hlr_10.42.42.2(pid=14306): stdout: | (launched: 2022-12-13_18:04:33.751022) 18:04:36.961314 run osmo-hlr_10.42.42.2(pid=14306): stderr: | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180433948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180433963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180433973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180433973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180433974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:37.035503 run osmo-msc_10.42.42.6(pid=14312): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14312)] 18:04:37.086894 run osmo-msc_10.42.42.6(pid=14312): stdout: | (launched: 2022-12-13_18:04:35.854827) 18:04:37.140535 run osmo-msc_10.42.42.6(pid=14312): stderr: | [0;m[38;5;43m20221213180436175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180436175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6583080c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180436175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180436175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180436175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180436176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180436177 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180436178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180436178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180436178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:37.194160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Terminating (SIGTERM) 18:04:37.236886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Terminating (SIGTERM) 18:04:37.280318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Terminating (SIGTERM) 18:04:37.324361 --- ParallelTerminationStrategy: PID 14305 died... 18:04:37.345601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Terminated: ok {rc=0} 18:04:37.393636 --- ParallelTerminationStrategy: PID 14308 died... 18:04:37.414465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Terminated: ok {rc=0} 18:04:37.462411 --- ParallelTerminationStrategy: PID 14311 died... 18:04:37.483261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Terminated: ok {rc=0} 18:04:37.573818 bus /sierra_3: Setting Powered False 18:04:38.675887 bus /sierra_3: Setting Powered False 18:04:39.794246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:04:41.046338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:41.054011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:04:41.083128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:04:41.110102 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:04:41.167958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:04:41.197072 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:04:41.223935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:04:41.775977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:04:41.827130 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:41.838523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:41.904015 tst mo_mt_call.py: using LAC 35323 18:04:42.025064 tst mo_mt_call.py: using RAC 133 18:04:42.146911 tst mo_mt_call.py: using CellId 35323 18:04:42.270144 tst mo_mt_call.py: using BVCI 35324 18:04:42.381834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:42.393235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:42.404222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:42.415721 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:42.426955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:42.438111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:42.556602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:42.680287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:43.160761 run create_hlr_db(pid=14317): Launched 18:04:43.286774 bus /sierra_2: Setting Powered False 18:04:44.349610 run create_hlr_db(pid=14317): Terminated: ok {rc=0} 18:04:44.783315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Launched 18:04:45.097560 run osmo-hlr_10.42.42.2(pid=14320): Launched 18:04:45.215615 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:45.751166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Launched 18:04:46.085747 run osmo-stp_10.42.42.5(pid=14323): Launched 18:04:46.306146 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:46.986800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Launched 18:04:47.337678 run osmo-msc_10.42.42.6(pid=14326): Launched 18:04:47.524747 run osmo-stp_10.42.42.5(pid=14323): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] 18:04:47.667130 run osmo-stp_10.42.42.5(pid=14323): stdout: | (launched: 2022-12-13_18:04:46.026876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:47.809234 run osmo-stp_10.42.42.5(pid=14323): stderr: | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180446340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:47.949460 run osmo-stp_10.42.42.5(pid=14323): stdout: | (launched: 2022-12-13_18:04:46.026876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:48.083321 run osmo-stp_10.42.42.5(pid=14323): stderr: | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180446339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180446340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180446340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:48.242285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14323): Process ended prematurely: osmo-stp_10.42.42.5(pid=14323) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:04:48.252236 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:04:48.280834 run osmo-hlr_10.42.42.2(pid=14320): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14320)] 18:04:48.333403 run osmo-hlr_10.42.42.2(pid=14320): stdout: | (launched: 2022-12-13_18:04:45.039523) 18:04:48.386637 run osmo-hlr_10.42.42.2(pid=14320): stderr: | [0;m[1;31m20221213180445216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180445216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180445216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180445217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180445217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180445217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180445229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180445237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180445237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180445237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:48.461318 run osmo-msc_10.42.42.6(pid=14326): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14326)] 18:04:48.512788 run osmo-msc_10.42.42.6(pid=14326): stdout: | (launched: 2022-12-13_18:04:47.275882) 18:04:48.566635 run osmo-msc_10.42.42.6(pid=14326): stderr: | [0;m[38;5;43m20221213180447597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180447597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68b78d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180447597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180447597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180447597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180447597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180447599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180447599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180447600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180447600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:48.620646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Terminating (SIGTERM) 18:04:48.664180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Terminating (SIGTERM) 18:04:48.707710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Terminating (SIGTERM) 18:04:48.751551 --- ParallelTerminationStrategy: PID 14319 died... 18:04:48.772847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Terminated: ok {rc=0} 18:04:48.821447 --- ParallelTerminationStrategy: PID 14322 died... 18:04:48.842208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Terminated: ok {rc=0} 18:04:48.889966 --- ParallelTerminationStrategy: PID 14325 died... 18:04:48.910688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Terminated: ok {rc=0} 18:04:49.001923 bus /sierra_3: Setting Powered False 18:04:50.101828 bus /sierra_3: Setting Powered False 18:04:51.219653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:04:52.372427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.385190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:52.454484 tst mo_mt_call_osmux.py: using LAC 35324 18:04:52.582260 tst mo_mt_call_osmux.py: using RAC 134 18:04:52.705470 tst mo_mt_call_osmux.py: using CellId 35324 18:04:52.825634 tst mo_mt_call_osmux.py: using BVCI 35325 18:04:52.937803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.949368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.960531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.971536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.982663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:52.993742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:53.118017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:53.239459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:53.720445 run create_hlr_db(pid=14328): Launched 18:04:53.845941 bus /sierra_2: Setting Powered False 18:04:54.907800 run create_hlr_db(pid=14328): Terminated: ok {rc=0} 18:04:55.361782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Launched 18:04:55.695023 run osmo-hlr_10.42.42.2(pid=14331): Launched 18:04:55.823003 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:56.398359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Launched 18:04:56.733437 run osmo-stp_10.42.42.5(pid=14334): Launched 18:04:56.861874 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:57.463727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Launched 18:04:57.798411 run osmo-msc_10.42.42.6(pid=14337): Launched 18:04:57.985196 run osmo-stp_10.42.42.5(pid=14334): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] 18:04:58.124892 run osmo-stp_10.42.42.5(pid=14334): stdout: | (launched: 2022-12-13_18:04:56.671801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:58.265175 run osmo-stp_10.42.42.5(pid=14334): stderr: | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180456866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:58.404312 run osmo-stp_10.42.42.5(pid=14334): stdout: | (launched: 2022-12-13_18:04:56.671801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:58.536698 run osmo-stp_10.42.42.5(pid=14334): stderr: | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180456865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180456866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180456866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:58.696000 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14334): Process ended prematurely: osmo-stp_10.42.42.5(pid=14334) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:04:58.706098 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:04:58.734755 run osmo-hlr_10.42.42.2(pid=14331): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14331)] 18:04:58.786680 run osmo-hlr_10.42.42.2(pid=14331): stdout: | (launched: 2022-12-13_18:04:55.633746) 18:04:58.840278 run osmo-hlr_10.42.42.2(pid=14331): stderr: | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180455830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180455843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180455854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180455855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180455855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:58.914822 run osmo-msc_10.42.42.6(pid=14337): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14337)] 18:04:58.966104 run osmo-msc_10.42.42.6(pid=14337): stdout: | (launched: 2022-12-13_18:04:57.736605) 18:04:59.019676 run osmo-msc_10.42.42.6(pid=14337): stderr: | [0;m[38;5;43m20221213180458059 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180458060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06a4662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180458060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180458060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180458060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180458060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180458062 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180458062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180458063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180458063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:59.074195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Terminating (SIGTERM) 18:04:59.117123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Terminating (SIGTERM) 18:04:59.160410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Terminating (SIGTERM) 18:04:59.203996 --- ParallelTerminationStrategy: PID 14330 died... 18:04:59.225011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Terminated: ok {rc=0} 18:04:59.272737 --- ParallelTerminationStrategy: PID 14333 died... 18:04:59.293370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Terminated: ok {rc=0} 18:04:59.340676 --- ParallelTerminationStrategy: PID 14336 died... 18:04:59.361390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Terminated: ok {rc=0} 18:04:59.451500 bus /sierra_3: Setting Powered False 18:05:00.550500 bus /sierra_3: Setting Powered False 18:05:01.677202 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:05:02.937648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:02.946185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:05:02.976069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:05:03.004424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:05:03.056386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:05:03.087227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:05:03.115373 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:05:03.669965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:05:03.724062 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:03.735968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:05:03.802518 tst mo_mt_call.py: using LAC 35325 18:05:03.933434 tst mo_mt_call.py: using RAC 135 18:05:04.062855 tst mo_mt_call.py: using CellId 35325 18:05:04.191185 tst mo_mt_call.py: using BVCI 35326 18:05:04.311811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:04.323649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:04.335238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:04.346910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:04.359423 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:04.371695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:05:04.491011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:05:04.613472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:05.130529 run create_hlr_db(pid=14345): Launched 18:05:05.258413 bus /sierra_2: Setting Powered False 18:05:06.324523 run create_hlr_db(pid=14345): Terminated: ok {rc=0} 18:05:06.771052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14347): Launched 18:05:07.082949 run osmo-hlr_10.42.42.2(pid=14348): Launched 18:05:07.201084 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:07.735852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14350): Launched 18:05:08.049172 run osmo-stp_10.42.42.5(pid=14351): Launched 18:05:08.168351 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:08.731454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14353): Launched 18:05:09.045367 run osmo-msc_10.42.42.6(pid=14354): Launched 18:05:09.220466 run osmo-stp_10.42.42.5(pid=14351): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14351)] 18:05:09.352316 run osmo-stp_10.42.42.5(pid=14351): stdout: | (launched: 2022-12-13_18:05:07.990925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:09.483473 run osmo-stp_10.42.42.5(pid=14351): stderr: | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180508163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:09.612714 run osmo-stp_10.42.42.5(pid=14351): stdout: | (launched: 2022-12-13_18:05:07.990925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:09.736092 run osmo-stp_10.42.42.5(pid=14351): stderr: | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180508162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180508163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180508163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:09.883791 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14351): Process ended prematurely: osmo-stp_10.42.42.5(pid=14351) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14351)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:05:09.892849 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:05:09.919839 run osmo-hlr_10.42.42.2(pid=14348): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14348)] 18:05:09.968901 run osmo-hlr_10.42.42.2(pid=14348): stdout: | (launched: 2022-12-13_18:05:07.025360) 18:05:10.020286 run osmo-hlr_10.42.42.2(pid=14348): stderr: | [0;m[1;31m20221213180507198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180507199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180507199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180507199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180507199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180507199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180507238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180507248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180507248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180507248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:10.096210 run osmo-msc_10.42.42.6(pid=14354): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14354)] 18:05:10.144839 run osmo-msc_10.42.42.6(pid=14354): stdout: | (launched: 2022-12-13_18:05:08.987316) 18:05:10.195240 run osmo-msc_10.42.42.6(pid=14354): stderr: | [0;m[38;5;43m20221213180509258 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180509258 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2318b26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180509258 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180509258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180509258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180509258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180509260 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180509261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180509261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180509261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:10.246202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14347): Terminating (SIGTERM) 18:05:10.286651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14350): Terminating (SIGTERM) 18:05:10.326868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14353): Terminating (SIGTERM) 18:05:10.367431 --- ParallelTerminationStrategy: PID 14347 died... 18:05:10.387016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14347): Terminated: ok {rc=0} 18:05:10.431782 --- ParallelTerminationStrategy: PID 14350 died... 18:05:10.450817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14350): Terminated: ok {rc=0} 18:05:10.495401 --- ParallelTerminationStrategy: PID 14353 died... 18:05:10.514519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14353): Terminated: ok {rc=0} 18:05:10.601619 bus /sierra_3: Setting Powered False 18:05:11.702325 bus /sierra_3: Setting Powered False 18:05:12.818692 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:05:13.972882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:13.985706 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:05:14.055784 tst mo_mt_call_osmux.py: using LAC 35326 18:05:14.188469 tst mo_mt_call_osmux.py: using RAC 136 18:05:14.318971 tst mo_mt_call_osmux.py: using CellId 35326 18:05:14.452221 tst mo_mt_call_osmux.py: using BVCI 35327 18:05:14.573923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:14.586054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:14.597957 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:14.609758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:14.622069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:05:14.634374 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:05:14.754809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:05:14.876900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:15.360734 run create_hlr_db(pid=14358): Launched 18:05:15.492522 bus /sierra_2: Setting Powered False 18:05:16.558642 run create_hlr_db(pid=14358): Terminated: ok {rc=0} 18:05:17.031856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Launched 18:05:17.379666 run osmo-hlr_10.42.42.2(pid=14361): Launched 18:05:17.509337 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:18.080060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Launched 18:05:18.414438 run osmo-stp_10.42.42.5(pid=14364): Launched 18:05:18.542976 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:19.145712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Launched 18:05:19.480568 run osmo-msc_10.42.42.6(pid=14367): Launched 18:05:19.667417 run osmo-stp_10.42.42.5(pid=14364): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] 18:05:19.809119 run osmo-stp_10.42.42.5(pid=14364): stdout: | (launched: 2022-12-13_18:05:18.352593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:19.951583 run osmo-stp_10.42.42.5(pid=14364): stderr: | [0;m[38;5;43m20221213180518546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180518547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180518547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180518547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:20.091547 run osmo-stp_10.42.42.5(pid=14364): stdout: | (launched: 2022-12-13_18:05:18.352593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:20.224319 run osmo-stp_10.42.42.5(pid=14364): stderr: | [0;m[38;5;43m20221213180518546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180518547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180518547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180518547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180518548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:20.383231 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14364): Process ended prematurely: osmo-stp_10.42.42.5(pid=14364) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:05:20.393351 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:05:20.421819 run osmo-hlr_10.42.42.2(pid=14361): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14361)] 18:05:20.473996 run osmo-hlr_10.42.42.2(pid=14361): stdout: | (launched: 2022-12-13_18:05:17.318315) 18:05:20.528762 run osmo-hlr_10.42.42.2(pid=14361): stderr: | [0;m[1;31m20221213180517517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180517518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180517518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180517518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180517518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180517518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180517556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180517566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180517566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180517566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:20.603021 run osmo-msc_10.42.42.6(pid=14367): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14367)] 18:05:20.654193 run osmo-msc_10.42.42.6(pid=14367): stdout: | (launched: 2022-12-13_18:05:19.418941) 18:05:20.708172 run osmo-msc_10.42.42.6(pid=14367): stderr: | [0;m[38;5;43m20221213180519740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180519741 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84fbbabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180519741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180519741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180519741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180519741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180519743 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180519743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180519743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180519743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:20.761809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Terminating (SIGTERM) 18:05:20.804807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Terminating (SIGTERM) 18:05:20.848104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Terminating (SIGTERM) 18:05:20.891682 --- ParallelTerminationStrategy: PID 14360 died... 18:05:20.912781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Terminated: ok {rc=0} 18:05:20.960416 --- ParallelTerminationStrategy: PID 14363 died... 18:05:20.981016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Terminated: ok {rc=0} 18:05:21.028376 --- ParallelTerminationStrategy: PID 14366 died... 18:05:21.049052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Terminated: ok {rc=0} 18:05:21.139281 bus /sierra_3: Setting Powered False 18:05:22.239439 bus /sierra_3: Setting Powered False 18:05:23.358022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:05:24.609094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:24.616409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:05:24.646368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:05:24.675139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:05:24.727943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:05:24.758597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:05:24.786630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:05:25.340146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:05:25.390009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:25.401550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:05:25.466647 tst mo_mt_call.py: using LAC 35327 18:05:25.588509 tst mo_mt_call.py: using RAC 137 18:05:25.712294 tst mo_mt_call.py: using CellId 35327 18:05:25.836133 tst mo_mt_call.py: using BVCI 35328 18:05:25.949871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:25.961261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:25.972199 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:25.983458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:25.994629 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:26.005728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:26.127950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:26.247497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:26.728363 run create_hlr_db(pid=14372): Launched 18:05:26.860061 bus /sierra_2: Setting Powered False 18:05:27.920634 run create_hlr_db(pid=14372): Terminated: ok {rc=0} 18:05:28.387610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Launched 18:05:28.722938 run osmo-hlr_10.42.42.2(pid=14375): Launched 18:05:28.851848 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:29.429069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Launched 18:05:29.763344 run osmo-stp_10.42.42.5(pid=14378): Launched 18:05:29.891829 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:30.495432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Launched 18:05:30.831998 run osmo-msc_10.42.42.6(pid=14381): Launched 18:05:31.281451 run osmo-stp_10.42.42.5(pid=14378): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] 18:05:31.530985 run osmo-stp_10.42.42.5(pid=14378): stdout: | (launched: 2022-12-13_18:05:29.702216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:31.694365 run osmo-stp_10.42.42.5(pid=14378): stderr: | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180529895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:31.836208 run osmo-stp_10.42.42.5(pid=14378): stdout: | (launched: 2022-12-13_18:05:29.702216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:31.972313 run osmo-stp_10.42.42.5(pid=14378): stderr: | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180529894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180529895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180529895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:32.134927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14378): Process ended prematurely: osmo-stp_10.42.42.5(pid=14378) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:05:32.145398 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 18:05:32.174635 run osmo-hlr_10.42.42.2(pid=14375): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14375)] 18:05:32.230187 run osmo-hlr_10.42.42.2(pid=14375): stdout: | (launched: 2022-12-13_18:05:28.661696) 18:05:32.285960 run osmo-hlr_10.42.42.2(pid=14375): stderr: | [0;m[1;31m20221213180528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180528861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180528873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180528882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180528883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180528883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:32.363148 run osmo-msc_10.42.42.6(pid=14381): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14381)] 18:05:32.417126 run osmo-msc_10.42.42.6(pid=14381): stdout: | (launched: 2022-12-13_18:05:30.768345) 18:05:32.471101 run osmo-msc_10.42.42.6(pid=14381): stderr: | [0;m[38;5;43m20221213180531123 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180531123 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb013a65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180531123 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180531123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180531124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180531125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180531129 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180531129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180531129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180531130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:32.525428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Terminating (SIGTERM) 18:05:32.568291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Terminating (SIGTERM) 18:05:32.612142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Terminating (SIGTERM) 18:05:32.655631 --- ParallelTerminationStrategy: PID 14374 died... 18:05:32.676283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Terminated: ok {rc=0} 18:05:32.724222 --- ParallelTerminationStrategy: PID 14377 died... 18:05:32.744749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Terminated: ok {rc=0} 18:05:32.792625 --- ParallelTerminationStrategy: PID 14380 died... 18:05:32.813302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Terminated: ok {rc=0} 18:05:32.904895 bus /sierra_3: Setting Powered False 18:05:34.005935 bus /sierra_3: Setting Powered False 18:05:35.125620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:05:36.278469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.291022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:05:36.358821 tst mo_mt_call_osmux.py: using LAC 35328 18:05:36.489456 tst mo_mt_call_osmux.py: using RAC 138 18:05:36.621391 tst mo_mt_call_osmux.py: using CellId 35328 18:05:36.751146 tst mo_mt_call_osmux.py: using BVCI 35329 18:05:36.872153 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.883979 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.895498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.907140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.919163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:36.931057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:37.049873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:37.170045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:37.653143 run create_hlr_db(pid=14383): Launched 18:05:37.780516 bus /sierra_2: Setting Powered False 18:05:38.843035 run create_hlr_db(pid=14383): Terminated: ok {rc=0} 18:05:39.298763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Launched 18:05:39.632504 run osmo-hlr_10.42.42.2(pid=14386): Launched 18:05:39.762323 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:40.340636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Launched 18:05:40.676523 run osmo-stp_10.42.42.5(pid=14389): Launched 18:05:40.804525 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:41.408140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Launched 18:05:41.743091 run osmo-msc_10.42.42.6(pid=14392): Launched 18:05:41.995383 run osmo-stp_10.42.42.5(pid=14389): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] 18:05:42.136604 run osmo-stp_10.42.42.5(pid=14389): stdout: | (launched: 2022-12-13_18:05:40.615091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:42.278218 run osmo-stp_10.42.42.5(pid=14389): stderr: | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180540811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:42.417271 run osmo-stp_10.42.42.5(pid=14389): stdout: | (launched: 2022-12-13_18:05:40.615091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:42.549922 run osmo-stp_10.42.42.5(pid=14389): stderr: | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180540810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180540811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180540811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:42.709233 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14389): Process ended prematurely: osmo-stp_10.42.42.5(pid=14389) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:05:42.719047 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:05:42.747730 run osmo-hlr_10.42.42.2(pid=14386): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14386)] 18:05:42.799587 run osmo-hlr_10.42.42.2(pid=14386): stdout: | (launched: 2022-12-13_18:05:39.570993) 18:05:42.852790 run osmo-hlr_10.42.42.2(pid=14386): stderr: | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180539769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180539781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180539790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180539790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180539790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:42.926554 run osmo-msc_10.42.42.6(pid=14392): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14392)] 18:05:42.977758 run osmo-msc_10.42.42.6(pid=14392): stdout: | (launched: 2022-12-13_18:05:41.681177) 18:05:43.030995 run osmo-msc_10.42.42.6(pid=14392): stderr: | [0;m[38;5;43m20221213180542001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180542001 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12efbdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180542001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180542001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180542001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180542002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180542003 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180542004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180542004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180542004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:43.085069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Terminating (SIGTERM) 18:05:43.127917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Terminating (SIGTERM) 18:05:43.171269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Terminating (SIGTERM) 18:05:43.214835 --- ParallelTerminationStrategy: PID 14385 died... 18:05:43.235980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Terminated: ok {rc=0} 18:05:43.283939 --- ParallelTerminationStrategy: PID 14388 died... 18:05:43.304550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Terminated: ok {rc=0} 18:05:43.352202 --- ParallelTerminationStrategy: PID 14391 died... 18:05:43.372781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Terminated: ok {rc=0} 18:05:43.463192 bus /sierra_3: Setting Powered False 18:05:44.563308 bus /sierra_3: Setting Powered False 18:05:45.682568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:05:46.957528 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:46.965665 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:05:46.996579 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:05:47.025945 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:05:47.082100 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:05:47.120667 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:05:47.149683 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:05:47.693995 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:05:47.748806 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:47.760649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:47.826472 tst mo_mt_call.py: using LAC 35329 18:05:47.954759 tst mo_mt_call.py: using RAC 139 18:05:48.083440 tst mo_mt_call.py: using CellId 35329 18:05:48.205617 tst mo_mt_call.py: using BVCI 35330 18:05:48.318631 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:48.330207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:48.341629 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:48.352866 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:48.364595 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:48.376280 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:48.498761 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:48.618896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:49.102767 run create_hlr_db(pid=14397): Launched 18:05:49.232531 bus /sierra_2: Setting Powered False 18:05:50.295078 run create_hlr_db(pid=14397): Terminated: ok {rc=0} 18:05:50.750690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Launched 18:05:51.085779 run osmo-hlr_10.42.42.2(pid=14400): Launched 18:05:51.213113 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:51.792512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Launched 18:05:52.129762 run osmo-stp_10.42.42.5(pid=14405): Launched 18:05:52.257845 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:52.863832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14407): Launched 18:05:53.199186 run osmo-msc_10.42.42.6(pid=14408): Launched 18:05:53.385870 run osmo-stp_10.42.42.5(pid=14405): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14405)] 18:05:53.525740 run osmo-stp_10.42.42.5(pid=14405): stdout: | (launched: 2022-12-13_18:05:52.067174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:53.667198 run osmo-stp_10.42.42.5(pid=14405): stderr: | [0;m[38;5;43m20221213180552260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180552260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180552261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180552261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180552261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180552262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180552262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:53.806694 run osmo-stp_10.42.42.5(pid=14405): stdout: | (launched: 2022-12-13_18:05:52.067174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:53.939300 run osmo-stp_10.42.42.5(pid=14405): stderr: | [0;m[38;5;43m20221213180552260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180552260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180552261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180552261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180552261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180552262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180552262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:54.098394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14405): Process ended prematurely: osmo-stp_10.42.42.5(pid=14405) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14405)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:05:54.108243 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:05:54.136673 run osmo-hlr_10.42.42.2(pid=14400): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14400)] 18:05:54.188788 run osmo-hlr_10.42.42.2(pid=14400): stdout: | (launched: 2022-12-13_18:05:51.023822) 18:05:54.241820 run osmo-hlr_10.42.42.2(pid=14400): stderr: | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180551221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180551234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180551245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180551246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180551246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:54.315433 run osmo-msc_10.42.42.6(pid=14408): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14408)] 18:05:54.366245 run osmo-msc_10.42.42.6(pid=14408): stdout: | (launched: 2022-12-13_18:05:53.137418) 18:05:54.419041 run osmo-msc_10.42.42.6(pid=14408): stderr: | [0;m[38;5;43m20221213180553459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180553459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96ced38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180553459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180553459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180553460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180553460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180553462 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180553462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180553462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180553462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:54.472056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Terminating (SIGTERM) 18:05:54.514625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Terminating (SIGTERM) 18:05:54.557383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14407): Terminating (SIGTERM) 18:05:54.600868 --- ParallelTerminationStrategy: PID 14399 died... 18:05:54.621637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Terminated: ok {rc=0} 18:05:54.669261 --- ParallelTerminationStrategy: PID 14402 died... 18:05:54.689722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Terminated: ok {rc=0} 18:05:54.737124 --- ParallelTerminationStrategy: PID 14407 died... 18:05:54.757399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14407): Terminated: ok {rc=0} 18:05:54.847767 bus /sierra_3: Setting Powered False 18:05:55.948707 bus /sierra_3: Setting Powered False 18:05:57.069968 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:05:58.222362 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.234934 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:58.304373 tst mo_mt_call_osmux.py: using LAC 35330 18:05:58.437568 tst mo_mt_call_osmux.py: using RAC 140 18:05:58.560154 tst mo_mt_call_osmux.py: using CellId 35330 18:05:58.683535 tst mo_mt_call_osmux.py: using BVCI 35331 18:05:58.797632 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.809233 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.820448 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.831943 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.843195 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:58.854443 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:58.976478 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:59.097308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:59.577656 run create_hlr_db(pid=14410): Launched 18:05:59.705649 bus /sierra_2: Setting Powered False 18:06:00.767681 run create_hlr_db(pid=14410): Terminated: ok {rc=0} 18:06:01.296613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14412): Launched 18:06:01.645502 run osmo-hlr_10.42.42.2(pid=14413): Launched 18:06:01.900250 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:02.550894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14415): Launched 18:06:02.863288 run osmo-stp_10.42.42.5(pid=14416): Launched 18:06:02.982597 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:03.543337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14418): Launched 18:06:03.854882 run osmo-msc_10.42.42.6(pid=14419): Launched 18:06:04.028874 run osmo-stp_10.42.42.5(pid=14416): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14416)] 18:06:04.167662 run osmo-stp_10.42.42.5(pid=14416): stdout: | (launched: 2022-12-13_18:06:02.805150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:04.309546 run osmo-stp_10.42.42.5(pid=14416): stderr: | [0;m[38;5;43m20221213180602976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180602976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180602977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180602977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:04.448621 run osmo-stp_10.42.42.5(pid=14416): stdout: | (launched: 2022-12-13_18:06:02.805150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:04.581835 run osmo-stp_10.42.42.5(pid=14416): stderr: | [0;m[38;5;43m20221213180602976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180602976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180602977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180602977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180602978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:04.740765 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14416): Process ended prematurely: osmo-stp_10.42.42.5(pid=14416) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14416)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:06:04.750774 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:06:04.779361 run osmo-hlr_10.42.42.2(pid=14413): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14413)] 18:06:04.831189 run osmo-hlr_10.42.42.2(pid=14413): stdout: | (launched: 2022-12-13_18:06:01.581430) 18:06:04.884679 run osmo-hlr_10.42.42.2(pid=14413): stderr: | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180601882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180601894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180601910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180601910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180601910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:04.958680 run osmo-msc_10.42.42.6(pid=14419): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14419)] 18:06:05.009719 run osmo-msc_10.42.42.6(pid=14419): stdout: | (launched: 2022-12-13_18:06:03.796838) 18:06:05.063057 run osmo-msc_10.42.42.6(pid=14419): stderr: | [0;m[38;5;43m20221213180604069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180604069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91ec18cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180604069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180604070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180604070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180604070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180604072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180604072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180604072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180604072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:05.117295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14412): Terminating (SIGTERM) 18:06:05.160039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14415): Terminating (SIGTERM) 18:06:05.202944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14418): Terminating (SIGTERM) 18:06:05.246695 --- ParallelTerminationStrategy: PID 14412 died... 18:06:05.267615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14412): Terminated: ok {rc=0} 18:06:05.315662 --- ParallelTerminationStrategy: PID 14415 died... 18:06:05.336201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14415): Terminated: ok {rc=0} 18:06:05.383709 --- ParallelTerminationStrategy: PID 14418 died... 18:06:05.404094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14418): Terminated: ok {rc=0} 18:06:05.493980 bus /sierra_3: Setting Powered False 18:06:06.594751 bus /sierra_3: Setting Powered False 18:06:07.713052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:06:08.972653 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:08.979297 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:06:09.009186 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:06:09.037236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:06:09.088525 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:06:09.118632 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:06:09.146347 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:06:09.700152 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:06:09.754959 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:09.766732 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:06:09.834622 tst mo_mt_call.py: using LAC 35331 18:06:09.962670 tst mo_mt_call.py: using RAC 141 18:06:10.090644 tst mo_mt_call.py: using CellId 35331 18:06:10.219384 tst mo_mt_call.py: using BVCI 35332 18:06:10.340259 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:10.352056 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:10.363644 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:10.375262 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:10.387691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:10.399995 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:06:10.519841 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:06:10.640559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:11.122339 run create_hlr_db(pid=14424): Launched 18:06:11.248729 bus /sierra_2: Setting Powered False 18:06:12.311358 run create_hlr_db(pid=14424): Terminated: ok {rc=0} 18:06:12.745477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14426): Launched 18:06:13.058612 run osmo-hlr_10.42.42.2(pid=14427): Launched 18:06:13.178963 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:13.728663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14429): Launched 18:06:14.041774 run osmo-stp_10.42.42.5(pid=14430): Launched 18:06:14.161451 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:14.725454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14432): Launched 18:06:15.038528 run osmo-msc_10.42.42.6(pid=14433): Launched 18:06:15.214975 run osmo-stp_10.42.42.5(pid=14430): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14430)] 18:06:15.346481 run osmo-stp_10.42.42.5(pid=14430): stdout: | (launched: 2022-12-13_18:06:13.983987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:15.477093 run osmo-stp_10.42.42.5(pid=14430): stderr: | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180614158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:15.606085 run osmo-stp_10.42.42.5(pid=14430): stdout: | (launched: 2022-12-13_18:06:13.983987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:15.729229 run osmo-stp_10.42.42.5(pid=14430): stderr: | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180614157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180614158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180614158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:15.893794 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14430): Process ended prematurely: osmo-stp_10.42.42.5(pid=14430) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14430)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:06:15.903298 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:06:15.931168 run osmo-hlr_10.42.42.2(pid=14427): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14427)] 18:06:15.980692 run osmo-hlr_10.42.42.2(pid=14427): stdout: | (launched: 2022-12-13_18:06:13.000444) 18:06:16.031787 run osmo-hlr_10.42.42.2(pid=14427): stderr: | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180613178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180613190 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180613199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180613199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180613199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:16.104257 run osmo-msc_10.42.42.6(pid=14433): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14433)] 18:06:16.154376 run osmo-msc_10.42.42.6(pid=14433): stdout: | (launched: 2022-12-13_18:06:14.980273) 18:06:16.205954 run osmo-msc_10.42.42.6(pid=14433): stderr: | [0;m[38;5;43m20221213180615251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180615251 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d46bf5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180615251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180615251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180615251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180615252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180615253 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180615254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180615254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180615254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:16.257475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14426): Terminating (SIGTERM) 18:06:16.298472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14429): Terminating (SIGTERM) 18:06:16.340155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14432): Terminating (SIGTERM) 18:06:16.383544 --- ParallelTerminationStrategy: PID 14426 died... 18:06:16.403565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14426): Terminated: ok {rc=0} 18:06:16.449544 --- ParallelTerminationStrategy: PID 14429 died... 18:06:16.469446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14429): Terminated: ok {rc=0} 18:06:16.515316 --- ParallelTerminationStrategy: PID 14432 died... 18:06:16.535067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14432): Terminated: ok {rc=0} 18:06:16.630069 bus /sierra_3: Setting Powered False 18:06:17.735002 bus /sierra_3: Setting Powered False 18:06:18.855779 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:06:20.005479 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.017447 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:06:20.089249 tst mo_mt_call_osmux.py: using LAC 35332 18:06:20.211986 tst mo_mt_call_osmux.py: using RAC 142 18:06:20.337121 tst mo_mt_call_osmux.py: using CellId 35332 18:06:20.458869 tst mo_mt_call_osmux.py: using BVCI 35333 18:06:20.572728 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.583968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.594944 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.605977 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.617023 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:06:20.627919 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:06:20.751654 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:06:20.871823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:21.355194 run create_hlr_db(pid=14435): Launched 18:06:21.481431 bus /sierra_2: Setting Powered False 18:06:22.547508 run create_hlr_db(pid=14435): Terminated: ok {rc=0} 18:06:23.011317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Launched 18:06:23.347173 run osmo-hlr_10.42.42.2(pid=14438): Launched 18:06:23.475317 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:24.052788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Launched 18:06:24.388159 run osmo-stp_10.42.42.5(pid=14441): Launched 18:06:24.515781 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:25.116662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14443): Launched 18:06:25.452335 run osmo-msc_10.42.42.6(pid=14444): Launched 18:06:25.638554 run osmo-stp_10.42.42.5(pid=14441): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] 18:06:25.778488 run osmo-stp_10.42.42.5(pid=14441): stdout: | (launched: 2022-12-13_18:06:24.326640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:25.919267 run osmo-stp_10.42.42.5(pid=14441): stderr: | [0;m[38;5;43m20221213180624519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180624519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180624520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180624520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180624520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180624520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180624521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.058544 run osmo-stp_10.42.42.5(pid=14441): stdout: | (launched: 2022-12-13_18:06:24.326640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:26.191364 run osmo-stp_10.42.42.5(pid=14441): stderr: | [0;m[38;5;43m20221213180624519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180624519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180624520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180624520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180624520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180624520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180624521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.349695 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14441): Process ended prematurely: osmo-stp_10.42.42.5(pid=14441) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:06:26.359581 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:06:26.387679 run osmo-hlr_10.42.42.2(pid=14438): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14438)] 18:06:26.438862 run osmo-hlr_10.42.42.2(pid=14438): stdout: | (launched: 2022-12-13_18:06:23.285775) 18:06:26.491307 run osmo-hlr_10.42.42.2(pid=14438): stderr: | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180623485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180623498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180623506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:26.565017 run osmo-msc_10.42.42.6(pid=14444): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14444)] 18:06:26.615493 run osmo-msc_10.42.42.6(pid=14444): stdout: | (launched: 2022-12-13_18:06:25.391286) 18:06:26.668152 run osmo-msc_10.42.42.6(pid=14444): stderr: | [0;m[38;5;43m20221213180625714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180625715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feadc792c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180625715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180625715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180625715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180625715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180625717 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180625717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180625717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180625718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:26.721134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Terminating (SIGTERM) 18:06:26.763373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Terminating (SIGTERM) 18:06:26.806517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14443): Terminating (SIGTERM) 18:06:26.849471 --- ParallelTerminationStrategy: PID 14437 died... 18:06:26.870289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Terminated: ok {rc=0} 18:06:26.917563 --- ParallelTerminationStrategy: PID 14440 died... 18:06:26.937729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Terminated: ok {rc=0} 18:06:26.984817 --- ParallelTerminationStrategy: PID 14443 died... 18:06:27.005644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14443): Terminated: ok {rc=0} 18:06:27.095757 bus /sierra_3: Setting Powered False 18:06:28.195794 bus /sierra_3: Setting Powered False 18:06:29.315450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 18:06:30.560453 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:30.565143 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:06:30.594303 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:06:30.620810 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:06:30.704719 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:06:30.735861 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:06:30.763922 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:06:31.352339 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 18:06:31.359788 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.371169 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:31.416594 tst emergency_mo_mt_call.py: using LAC 35333 18:06:31.544167 tst emergency_mo_mt_call.py: using RAC 143 18:06:31.662589 tst emergency_mo_mt_call.py: using CellId 35333 18:06:31.796338 tst emergency_mo_mt_call.py: using BVCI 35334 18:06:31.919512 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.932145 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.944368 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.956585 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.969966 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:31.983352 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:32.112325 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:32.238056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:32.745876 run create_hlr_db(pid=14449): Launched 18:06:32.870891 bus /sierra_2: Setting Powered False 18:06:33.936064 run create_hlr_db(pid=14449): Terminated: ok {rc=0} 18:06:34.392320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14451): Launched 18:06:34.721519 run osmo-hlr_10.42.42.2(pid=14452): Launched 18:06:34.846979 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:35.415004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14454): Launched 18:06:35.742439 run osmo-stp_10.42.42.5(pid=14455): Launched 18:06:35.881880 tst emergency_mo_mt_call.py: using MSISDN 8257 18:06:36.049483 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:36.642655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14457): Launched 18:06:36.970855 run osmo-msc_10.42.42.6(pid=14458): Launched 18:06:37.154811 run osmo-stp_10.42.42.5(pid=14455): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14455)] 18:06:37.292393 run osmo-stp_10.42.42.5(pid=14455): stdout: | (launched: 2022-12-13_18:06:35.681840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:37.430719 run osmo-stp_10.42.42.5(pid=14455): stderr: | [0;m[38;5;43m20221213180635873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180635874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180635874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180635874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:37.567168 run osmo-stp_10.42.42.5(pid=14455): stdout: | (launched: 2022-12-13_18:06:35.681840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:37.696842 run osmo-stp_10.42.42.5(pid=14455): stderr: | [0;m[38;5;43m20221213180635873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180635874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180635874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180635874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180635875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:37.852244 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14455): Process ended prematurely: osmo-stp_10.42.42.5(pid=14455) [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14455)] [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 18:06:37.861693 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 18:06:37.889830 run osmo-hlr_10.42.42.2(pid=14452): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14452)] 18:06:37.941514 run osmo-hlr_10.42.42.2(pid=14452): stdout: | (launched: 2022-12-13_18:06:34.660818) 18:06:37.994442 run osmo-hlr_10.42.42.2(pid=14452): stderr: | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180634858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180634871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180634880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180634881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180634881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:38.067896 run osmo-msc_10.42.42.6(pid=14458): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14458)] 18:06:38.119119 run osmo-msc_10.42.42.6(pid=14458): stdout: | (launched: 2022-12-13_18:06:36.910307) 18:06:38.171776 run osmo-msc_10.42.42.6(pid=14458): stderr: | [0;m[38;5;43m20221213180637230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180637231 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b96c18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180637231 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180637231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180637231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180637231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180637233 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180637233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180637234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180637234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:38.225057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14451): Terminating (SIGTERM) 18:06:38.267247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14454): Terminating (SIGTERM) 18:06:38.310475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14457): Terminating (SIGTERM) 18:06:38.353896 --- ParallelTerminationStrategy: PID 14451 died... 18:06:38.374933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14451): Terminated: ok {rc=0} 18:06:38.422310 --- ParallelTerminationStrategy: PID 14454 died... 18:06:38.442406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14454): Terminated: ok {rc=0} 18:06:38.489680 --- ParallelTerminationStrategy: PID 14457 died... 18:06:38.510044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14457): Terminated: ok {rc=0} 18:06:38.599633 bus /sierra_3: Setting Powered False 18:06:39.697980 bus /sierra_3: Setting Powered False 18:06:40.814708 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 18:06:41.903319 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:41.915471 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:41.964001 tst emergency_preemptive_call.py: using LAC 35334 18:06:42.092500 tst emergency_preemptive_call.py: using RAC 144 18:06:42.221242 tst emergency_preemptive_call.py: using CellId 35334 18:06:42.351428 tst emergency_preemptive_call.py: using BVCI 35335 18:06:42.470204 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:42.481679 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:42.492795 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:42.503878 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:42.515255 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:42.526672 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.649135 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.766778 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:42.888440 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:43.009430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:43.517390 run create_hlr_db(pid=14460): Launched 18:06:43.642234 bus /sierra_2: Setting Powered False 18:06:44.707817 run create_hlr_db(pid=14460): Terminated: ok {rc=0} 18:06:45.163794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14462): Launched 18:06:45.492064 run osmo-hlr_10.42.42.2(pid=14463): Launched 18:06:45.617726 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:46.200287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14465): Launched 18:06:46.542166 run osmo-stp_10.42.42.5(pid=14466): Launched 18:06:46.802267 tst emergency_preemptive_call.py: using MSISDN 8258 18:06:47.057933 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:47.648230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14468): Launched 18:06:47.976074 run osmo-msc_10.42.42.6(pid=14469): Launched 18:06:48.158969 run osmo-stp_10.42.42.5(pid=14466): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14466)] 18:06:48.297626 run osmo-stp_10.42.42.5(pid=14466): stdout: | (launched: 2022-12-13_18:06:46.481654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:48.436294 run osmo-stp_10.42.42.5(pid=14466): stderr: | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180646772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:48.572549 run osmo-stp_10.42.42.5(pid=14466): stdout: | (launched: 2022-12-13_18:06:46.481654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:48.702537 run osmo-stp_10.42.42.5(pid=14466): stderr: | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180646772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180646772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180646781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:48.858332 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14466): Process ended prematurely: osmo-stp_10.42.42.5(pid=14466) [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14466)] [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 18:06:48.867547 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 18:06:48.895622 run osmo-hlr_10.42.42.2(pid=14463): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14463)] 18:06:48.947108 run osmo-hlr_10.42.42.2(pid=14463): stdout: | (launched: 2022-12-13_18:06:45.431981) 18:06:49.000309 run osmo-hlr_10.42.42.2(pid=14463): stderr: | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180645628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180645646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180645656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180645656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180645656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:49.073850 run osmo-msc_10.42.42.6(pid=14469): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14469)] 18:06:49.124586 run osmo-msc_10.42.42.6(pid=14469): stdout: | (launched: 2022-12-13_18:06:47.915561) 18:06:49.177755 run osmo-msc_10.42.42.6(pid=14469): stderr: | [0;m[38;5;43m20221213180648234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213180648234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78c2db8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213180648234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213180648234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213180648234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213180648235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213180648236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213180648237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213180648237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213180648237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:49.230893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14462): Terminating (SIGTERM) 18:06:49.273179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14465): Terminating (SIGTERM) 18:06:49.316268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14468): Terminating (SIGTERM) 18:06:49.359391 --- ParallelTerminationStrategy: PID 14462 died... 18:06:49.380318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14462): Terminated: ok {rc=0} 18:06:49.427692 --- ParallelTerminationStrategy: PID 14465 died... 18:06:49.448068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14465): Terminated: ok {rc=0} 18:06:49.495495 --- ParallelTerminationStrategy: PID 14468 died... 18:06:49.515862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14468): Terminated: ok {rc=0} 18:06:49.605664 bus /sierra_9: Setting Powered False 18:06:50.705841 bus /sierra_9: Setting Powered False 18:06:51.821979 bus /sierra_8: Setting Powered False 18:06:52.918627 bus /sierra_8: Setting Powered False 18:06:54.035800 bus /sierra_3: Setting Powered False 18:06:55.134966 bus /sierra_3: Setting Powered False 18:06:56.251486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 18:06:57.533267 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:57.537678 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:06:57.566460 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 18:06:57.604784 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:06:57.690364 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:06:57.721226 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 18:06:57.762104 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:06:58.349696 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 18:06:58.400766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.411668 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:58.454895 tst cs_paging_gprs_active.py: using LAC 35335 18:06:58.578294 tst cs_paging_gprs_active.py: using RAC 145 18:06:58.699863 tst cs_paging_gprs_active.py: using CellId 35335 18:06:58.820263 tst cs_paging_gprs_active.py: using BVCI 35336 18:06:58.933742 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.944565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.955184 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.965851 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.976396 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.987503 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.998238 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:59.008689 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:59.019394 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.142918 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.261619 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:06:59.472284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:59.785617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14475): Launched 18:07:00.057806 run iperf3-srv_10.42.42.10(pid=14476): Launched 18:07:00.175191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:07:00.382672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:00.695236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14477): Launched 18:07:00.998862 run iperf3-srv_10.42.42.10(pid=14478): Launched 18:07:01.133512 tst cs_paging_gprs_active.py:38: start network... 18:07:01.348176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:01.843977 run create_hlr_db(pid=14479): Launched 18:07:02.007126 bus /sierra_2: Setting Powered False 18:07:03.072558 run create_hlr_db(pid=14479): Terminated: ok {rc=0} 18:07:03.520866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14481): Launched 18:07:03.835091 run osmo-hlr_10.42.42.2(pid=14482): Launched 18:07:03.953250 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:04.504034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14484): Launched 18:07:04.817455 run osmo-stp_10.42.42.5(pid=14485): Launched 18:07:04.935295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:05.471578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14487): Launched 18:07:05.591520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:05.855799 run patchelf(pid=14488): Launched 18:07:06.030544 run osmo-stp_10.42.42.5(pid=14485): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14485)] 18:07:06.162664 run osmo-stp_10.42.42.5(pid=14485): stdout: | (launched: 2022-12-13_18:07:04.759374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:06.295959 run osmo-stp_10.42.42.5(pid=14485): stderr: | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180704934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:06.428929 run osmo-stp_10.42.42.5(pid=14485): stdout: | (launched: 2022-12-13_18:07:04.759374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:06.555742 run osmo-stp_10.42.42.5(pid=14485): stderr: | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180704932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180704934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180704934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:06.705912 run patchelf(pid=14488): Terminating (SIGINT) 18:07:06.882433 run patchelf(pid=14488): Terminated: ok {rc=0} 18:07:07.009450 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14485): Process ended prematurely: osmo-stp_10.42.42.5(pid=14485) [trial-2392↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14485)] [trial-2392↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 18:07:07.018994 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:07:07.046709 run osmo-hlr_10.42.42.2(pid=14482): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14482)] 18:07:07.095158 run osmo-hlr_10.42.42.2(pid=14482): stdout: | (launched: 2022-12-13_18:07:03.777215) 18:07:07.145469 run osmo-hlr_10.42.42.2(pid=14482): stderr: | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180703954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180703966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180703975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180703975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180703975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:07.196223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14475): Terminating (SIGTERM) 18:07:07.236688 run iperf3-srv_10.42.42.10(pid=14476): Terminating (SIGTERM) 18:07:07.277252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14477): Terminating (SIGTERM) 18:07:07.317696 run iperf3-srv_10.42.42.10(pid=14478): Terminating (SIGTERM) 18:07:07.357892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14481): Terminating (SIGTERM) 18:07:07.398242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14484): Terminating (SIGTERM) 18:07:07.438507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14487): Terminating (SIGTERM) 18:07:07.479299 --- ParallelTerminationStrategy: PID 14475 died... 18:07:07.498877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14475): Terminated: ok {rc=0} 18:07:07.543717 --- ParallelTerminationStrategy: PID 14476 died... 18:07:07.562648 run iperf3-srv_10.42.42.10(pid=14476): Terminated {rc=256} 18:07:07.607676 --- ParallelTerminationStrategy: PID 14477 died... 18:07:07.626824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14477): Terminated: ok {rc=0} 18:07:07.671544 --- ParallelTerminationStrategy: PID 14478 died... 18:07:07.690542 run iperf3-srv_10.42.42.10(pid=14478): Terminated {rc=256} 18:07:07.735139 --- ParallelTerminationStrategy: PID 14481 died... 18:07:07.754166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14481): Terminated: ok {rc=0} 18:07:07.798437 --- ParallelTerminationStrategy: PID 14484 died... 18:07:07.817474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14484): Terminated: ok {rc=0} 18:07:07.861657 --- ParallelTerminationStrategy: PID 14487 died... 18:07:07.880290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14487): Terminated: ok {rc=0} 18:07:07.966705 bus /gobi_0: Setting Powered False 18:07:09.067460 bus /gobi_0: Setting Powered False 18:07:10.185473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 18:07:11.334269 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.345723 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:11.397938 tst iperf3.py: using LAC 35336 18:07:11.519799 tst iperf3.py: using RAC 146 18:07:11.640024 tst iperf3.py: using CellId 35336 18:07:11.762304 tst iperf3.py: using BVCI 35337 18:07:11.877389 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.888152 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.898706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.909258 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.919741 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.931538 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.942903 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.953942 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:11.965143 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:12.087360 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:12.313152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:12.648428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14489): Launched 18:07:12.941023 run iperf3-srv_10.42.42.10(pid=14490): Launched 18:07:13.067143 tst iperf3.py:8: start network... 18:07:13.292455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:13.808071 run create_hlr_db(pid=14491): Launched 18:07:13.937566 bus /gobi_6: Setting Powered False 18:07:14.999369 run create_hlr_db(pid=14491): Terminated: ok {rc=0} 18:07:15.443689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14493): Launched 18:07:15.756151 run osmo-hlr_10.42.42.2(pid=14494): Launched 18:07:15.937982 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:16.604669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14496): Launched 18:07:16.960223 run osmo-stp_10.42.42.5(pid=14497): Launched 18:07:17.221781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:17.815379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14499): Launched 18:07:17.935596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:18.198771 run patchelf(pid=14500): Launched 18:07:18.373218 run osmo-stp_10.42.42.5(pid=14497): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14497)] 18:07:18.504594 run osmo-stp_10.42.42.5(pid=14497): stdout: | (launched: 2022-12-13_18:07:16.896883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:18.637423 run osmo-stp_10.42.42.5(pid=14497): stderr: | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180717197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:18.770208 run osmo-stp_10.42.42.5(pid=14497): stdout: | (launched: 2022-12-13_18:07:16.896883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:18.896686 run osmo-stp_10.42.42.5(pid=14497): stderr: | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180717196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180717197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180717197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:19.046942 run patchelf(pid=14500): Terminating (SIGINT) 18:07:19.223323 run patchelf(pid=14500): Terminated: ok {rc=0} 18:07:19.349949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14497): Process ended prematurely: osmo-stp_10.42.42.5(pid=14497) [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14497)] [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 18:07:19.359348 tst iperf3.py:8: Test FAILED (8.1 sec) 18:07:19.386818 run osmo-hlr_10.42.42.2(pid=14494): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14494)] 18:07:19.435028 run osmo-hlr_10.42.42.2(pid=14494): stdout: | (launched: 2022-12-13_18:07:15.698285) 18:07:19.485551 run osmo-hlr_10.42.42.2(pid=14494): stderr: | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180715876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180715889 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180715905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180715906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180715906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:19.535717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14489): Terminating (SIGTERM) 18:07:19.575747 run iperf3-srv_10.42.42.10(pid=14490): Terminating (SIGTERM) 18:07:19.615607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14493): Terminating (SIGTERM) 18:07:19.655502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14496): Terminating (SIGTERM) 18:07:19.695922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14499): Terminating (SIGTERM) 18:07:19.736484 --- ParallelTerminationStrategy: PID 14489 died... 18:07:19.755904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14489): Terminated: ok {rc=0} 18:07:19.800778 --- ParallelTerminationStrategy: PID 14490 died... 18:07:19.820019 run iperf3-srv_10.42.42.10(pid=14490): Terminated {rc=256} 18:07:19.864667 --- ParallelTerminationStrategy: PID 14493 died... 18:07:19.883959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14493): Terminated: ok {rc=0} 18:07:19.928721 --- ParallelTerminationStrategy: PID 14496 died... 18:07:19.947832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14496): Terminated: ok {rc=0} 18:07:19.992245 --- ParallelTerminationStrategy: PID 14499 died... 18:07:20.011415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14499): Terminated: ok {rc=0} 18:07:20.097845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 18:07:21.249444 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.260885 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:21.305923 tst iperf3m4.py: using LAC 35337 18:07:21.438254 tst iperf3m4.py: using RAC 147 18:07:21.568092 tst iperf3m4.py: using CellId 35337 18:07:21.698737 tst iperf3m4.py: using BVCI 35338 18:07:21.822129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.833628 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.844737 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.855950 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.867274 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.878681 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.890388 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.901735 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:21.913280 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:22.034580 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:22.161545 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:22.285701 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:22.412570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:22.637427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:22.971183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14501): Launched 18:07:23.262607 run iperf3-srv_10.42.42.10(pid=14502): Launched 18:07:23.387718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:07:23.612522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:23.948586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14503): Launched 18:07:24.241628 run iperf3-srv_10.42.42.10(pid=14504): Launched 18:07:24.368343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:07:24.593911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:24.930530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14505): Launched 18:07:25.223476 run iperf3-srv_10.42.42.10(pid=14506): Launched 18:07:25.349729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:07:25.574647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:25.910955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14507): Launched 18:07:26.203244 run iperf3-srv_10.42.42.10(pid=14508): Launched 18:07:26.329860 tst iperf3m4.py:8: start network... 18:07:26.555060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:27.070364 run create_hlr_db(pid=14509): Launched 18:07:27.199407 bus /gobi_6: Setting Powered False 18:07:28.265198 run create_hlr_db(pid=14509): Terminated: ok {rc=0} 18:07:28.710004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14511): Launched 18:07:29.022629 run osmo-hlr_10.42.42.2(pid=14512): Launched 18:07:29.141041 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:29.792859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14514): Launched 18:07:30.096859 run osmo-stp_10.42.42.5(pid=14515): Launched 18:07:30.212112 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:30.736812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14517): Launched 18:07:30.858976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:31.131516 run patchelf(pid=14518): Launched 18:07:31.331650 run osmo-stp_10.42.42.5(pid=14515): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14515)] 18:07:31.473820 run osmo-stp_10.42.42.5(pid=14515): stdout: | (launched: 2022-12-13_18:07:30.040314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:31.610465 run osmo-stp_10.42.42.5(pid=14515): stderr: | [0;m[38;5;43m20221213180730209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180730210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180730210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180730210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:31.743792 run osmo-stp_10.42.42.5(pid=14515): stdout: | (launched: 2022-12-13_18:07:30.040314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:31.871061 run osmo-stp_10.42.42.5(pid=14515): stderr: | [0;m[38;5;43m20221213180730209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180730210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180730210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180730210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180730211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:32.022242 run patchelf(pid=14518): Terminating (SIGINT) 18:07:32.199126 run patchelf(pid=14518): Terminated: ok {rc=0} 18:07:32.325224 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14515): Process ended prematurely: osmo-stp_10.42.42.5(pid=14515) [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14515)] [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 18:07:32.335006 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:07:32.362789 run osmo-hlr_10.42.42.2(pid=14512): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14512)] 18:07:32.411250 run osmo-hlr_10.42.42.2(pid=14512): stdout: | (launched: 2022-12-13_18:07:28.963614) 18:07:32.461392 run osmo-hlr_10.42.42.2(pid=14512): stderr: | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180729140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180729152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180729161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180729161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180729161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:32.511511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14501): Terminating (SIGTERM) 18:07:32.551593 run iperf3-srv_10.42.42.10(pid=14502): Terminating (SIGTERM) 18:07:32.591424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14503): Terminating (SIGTERM) 18:07:32.631232 run iperf3-srv_10.42.42.10(pid=14504): Terminating (SIGTERM) 18:07:32.670889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14505): Terminating (SIGTERM) 18:07:32.710748 run iperf3-srv_10.42.42.10(pid=14506): Terminating (SIGTERM) 18:07:32.750369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14507): Terminating (SIGTERM) 18:07:32.790150 run iperf3-srv_10.42.42.10(pid=14508): Terminating (SIGTERM) 18:07:32.830012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14511): Terminating (SIGTERM) 18:07:32.869988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14514): Terminating (SIGTERM) 18:07:32.909714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14517): Terminating (SIGTERM) 18:07:32.950027 --- ParallelTerminationStrategy: PID 14501 died... 18:07:32.969537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14501): Terminated: ok {rc=0} 18:07:33.013942 --- ParallelTerminationStrategy: PID 14502 died... 18:07:33.032689 run iperf3-srv_10.42.42.10(pid=14502): Terminated {rc=256} 18:07:33.077279 --- ParallelTerminationStrategy: PID 14503 died... 18:07:33.096056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14503): Terminated: ok {rc=0} 18:07:33.140435 --- ParallelTerminationStrategy: PID 14504 died... 18:07:33.159339 run iperf3-srv_10.42.42.10(pid=14504): Terminated {rc=256} 18:07:33.203511 --- ParallelTerminationStrategy: PID 14505 died... 18:07:33.222630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14505): Terminated: ok {rc=0} 18:07:33.266827 --- ParallelTerminationStrategy: PID 14506 died... 18:07:33.285643 run iperf3-srv_10.42.42.10(pid=14506): Terminated {rc=256} 18:07:33.329778 --- ParallelTerminationStrategy: PID 14507 died... 18:07:33.348644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14507): Terminated: ok {rc=0} 18:07:33.392924 --- ParallelTerminationStrategy: PID 14508 died... 18:07:33.412058 run iperf3-srv_10.42.42.10(pid=14508): Terminated {rc=256} 18:07:33.456310 --- ParallelTerminationStrategy: PID 14511 died... 18:07:33.475413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14511): Terminated: ok {rc=0} 18:07:33.519754 --- ParallelTerminationStrategy: PID 14514 died... 18:07:33.538577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14514): Terminated: ok {rc=0} 18:07:33.582898 --- ParallelTerminationStrategy: PID 14517 died... 18:07:33.601921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14517): Terminated: ok {rc=0} 18:07:33.685654 bus /gobi_4: Setting Powered False 18:07:34.783520 bus /gobi_4: Setting Powered False 18:07:35.896670 bus /gobi_1: Setting Powered False 18:07:36.995275 bus /gobi_1: Setting Powered False 18:07:38.113776 bus /gobi_0: Setting Powered False 18:07:39.212449 bus /gobi_0: Setting Powered False 18:07:40.326449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 18:07:41.430466 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:41.442364 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:41.491916 tst ping.py: using LAC 35338 18:07:41.621555 tst ping.py: using RAC 148 18:07:41.739491 tst ping.py: using CellId 35338 18:07:41.854423 tst ping.py: using BVCI 35339 18:07:41.965231 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:41.976059 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:41.986901 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:41.997382 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:42.007690 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:42.018810 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:42.029684 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:42.040635 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:42.155379 tst ping.py:19: start network... 18:07:42.355796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:42.817535 run create_hlr_db(pid=14520): Launched 18:07:42.945212 bus /gobi_6: Setting Powered False 18:07:44.008483 run create_hlr_db(pid=14520): Terminated: ok {rc=0} 18:07:44.439024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Launched 18:07:44.738112 run osmo-hlr_10.42.42.2(pid=14523): Launched 18:07:44.850973 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:45.368156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Launched 18:07:45.668682 run osmo-stp_10.42.42.5(pid=14526): Launched 18:07:45.782179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:46.517766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Launched 18:07:46.649907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:46.933218 run patchelf(pid=14529): Launched 18:07:47.128712 run osmo-stp_10.42.42.5(pid=14526): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] 18:07:47.267650 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-13_18:07:45.612034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:47.407916 run osmo-stp_10.42.42.5(pid=14526): stderr: | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180745782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:47.545950 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-13_18:07:45.612034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:47.677239 run osmo-stp_10.42.42.5(pid=14526): stderr: | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180745781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180745782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180745782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:47.832854 run patchelf(pid=14529): Terminating (SIGINT) 18:07:48.014982 run patchelf(pid=14529): Terminated: ok {rc=0} 18:07:48.145585 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2392↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] [trial-2392↪gprs:trx-lms-limenet-micro↪ping.py:22] 18:07:48.155994 tst ping.py:22: Test FAILED (6.7 sec) 18:07:48.184327 run osmo-hlr_10.42.42.2(pid=14523): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14523)] 18:07:48.236479 run osmo-hlr_10.42.42.2(pid=14523): stdout: | (launched: 2022-12-13_18:07:44.682604) 18:07:48.289921 run osmo-hlr_10.42.42.2(pid=14523): stderr: | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180744857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180744870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180744878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180744879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180744879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:48.343337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminating (SIGTERM) 18:07:48.385931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminating (SIGTERM) 18:07:48.428854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Terminating (SIGTERM) 18:07:48.472019 --- ParallelTerminationStrategy: PID 14522 died... 18:07:48.492826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminated: ok {rc=0} 18:07:48.540453 --- ParallelTerminationStrategy: PID 14525 died... 18:07:48.560514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminated: ok {rc=0} 18:07:48.607798 --- ParallelTerminationStrategy: PID 14528 died... 18:07:48.628140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Terminated: ok {rc=0} 18:07:48.718354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 18:07:49.805766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:49.817994 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:49.865479 tst ping_idle_ping.py: using LAC 35339 18:07:49.993375 tst ping_idle_ping.py: using RAC 149 18:07:50.120056 tst ping_idle_ping.py: using CellId 35339 18:07:50.246170 tst ping_idle_ping.py: using BVCI 35340 18:07:50.363136 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.374467 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.385754 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.396779 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.408033 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.419273 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.431366 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:50.443040 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:50.560052 tst ping_idle_ping.py:24: start network... 18:07:50.762661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:51.230382 run create_hlr_db(pid=14530): Launched 18:07:51.352469 bus /gobi_6: Setting Powered False 18:07:52.413386 run create_hlr_db(pid=14530): Terminated: ok {rc=0} 18:07:52.853314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14532): Launched 18:07:53.175321 run osmo-hlr_10.42.42.2(pid=14533): Launched 18:07:53.297471 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:53.855213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Launched 18:07:54.179368 run osmo-stp_10.42.42.5(pid=14536): Launched 18:07:54.303235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:54.868843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14538): Launched 18:07:54.993284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:55.265982 run patchelf(pid=14539): Launched 18:07:55.446040 run osmo-stp_10.42.42.5(pid=14536): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14536)] 18:07:55.582951 run osmo-stp_10.42.42.5(pid=14536): stdout: | (launched: 2022-12-13_18:07:54.119105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:55.722009 run osmo-stp_10.42.42.5(pid=14536): stderr: | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180754311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:55.861134 run osmo-stp_10.42.42.5(pid=14536): stdout: | (launched: 2022-12-13_18:07:54.119105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:55.993563 run osmo-stp_10.42.42.5(pid=14536): stderr: | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180754310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180754311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180754311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:56.152216 run patchelf(pid=14539): Terminating (SIGINT) 18:07:56.334839 run patchelf(pid=14539): Terminated: ok {rc=0} 18:07:56.465964 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14536): Process ended prematurely: osmo-stp_10.42.42.5(pid=14536) [trial-2392↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14536)] [trial-2392↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 18:07:56.475791 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:07:56.504117 run osmo-hlr_10.42.42.2(pid=14533): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14533)] 18:07:56.555529 run osmo-hlr_10.42.42.2(pid=14533): stdout: | (launched: 2022-12-13_18:07:53.115220) 18:07:56.608278 run osmo-hlr_10.42.42.2(pid=14533): stderr: | [0;m[1;31m20221213180753310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180753311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180753311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180753311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180753311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180753311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180753324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180753332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180753332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180753332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:56.661447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14532): Terminating (SIGTERM) 18:07:56.703570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Terminating (SIGTERM) 18:07:56.746126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14538): Terminating (SIGTERM) 18:07:56.788780 --- ParallelTerminationStrategy: PID 14532 died... 18:07:56.809305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14532): Terminated: ok {rc=0} 18:07:56.856060 --- ParallelTerminationStrategy: PID 14535 died... 18:07:56.875960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Terminated: ok {rc=0} 18:07:56.922908 --- ParallelTerminationStrategy: PID 14538 died... 18:07:56.942831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14538): Terminated: ok {rc=0} 18:07:57.031989 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 18:07:58.334495 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:07:58.340199 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:07:58.369886 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:07:58.411352 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:07:58.500394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:07:58.530193 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:07:58.570054 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:07:59.167885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:07:59.221771 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.233232 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:59.281156 tst cs_paging_gprs_active.py: using LAC 35340 18:07:59.408888 tst cs_paging_gprs_active.py: using RAC 150 18:07:59.535715 tst cs_paging_gprs_active.py: using CellId 35340 18:07:59.663991 tst cs_paging_gprs_active.py: using BVCI 35341 18:07:59.782323 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.793924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.805259 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.816562 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.828126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.839709 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.851432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.862976 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.874787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:59.993661 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:00.111525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:08:00.317172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:00.625623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Launched 18:08:00.917793 run iperf3-srv_10.42.42.10(pid=14544): Launched 18:08:01.045293 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:08:01.253360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:01.568866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Launched 18:08:01.857749 run iperf3-srv_10.42.42.10(pid=14546): Launched 18:08:01.981557 tst cs_paging_gprs_active.py:38: start network... 18:08:02.193756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:02.669622 run create_hlr_db(pid=14547): Launched 18:08:02.796750 bus /gobi_6: Setting Powered False 18:08:03.857899 run create_hlr_db(pid=14547): Terminated: ok {rc=0} 18:08:04.306274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Launched 18:08:04.634544 run osmo-hlr_10.42.42.2(pid=14550): Launched 18:08:04.761851 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:05.328830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Launched 18:08:05.658067 run osmo-stp_10.42.42.5(pid=14553): Launched 18:08:05.783589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:06.351688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Launched 18:08:06.479834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:06.757948 run patchelf(pid=14556): Launched 18:08:06.940046 run osmo-stp_10.42.42.5(pid=14553): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] 18:08:07.079444 run osmo-stp_10.42.42.5(pid=14553): stdout: | (launched: 2022-12-13_18:08:05.597744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:07.220715 run osmo-stp_10.42.42.5(pid=14553): stderr: | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180805791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:07.361633 run osmo-stp_10.42.42.5(pid=14553): stdout: | (launched: 2022-12-13_18:08:05.597744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:07.495855 run osmo-stp_10.42.42.5(pid=14553): stderr: | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180805790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180805791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180805791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:07.655306 run patchelf(pid=14556): Terminating (SIGINT) 18:08:07.841162 run patchelf(pid=14556): Terminated: ok {rc=0} 18:08:07.974946 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14553): Process ended prematurely: osmo-stp_10.42.42.5(pid=14553) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:08:07.985193 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:08:08.014104 run osmo-hlr_10.42.42.2(pid=14550): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14550)] 18:08:08.065513 run osmo-hlr_10.42.42.2(pid=14550): stdout: | (launched: 2022-12-13_18:08:04.574214) 18:08:08.118961 run osmo-hlr_10.42.42.2(pid=14550): stderr: | [0;m[1;31m20221213180804771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180804771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180804771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180804771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180804771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180804772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180804783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180804792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180804793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180804793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:08.172793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminating (SIGTERM) 18:08:08.215410 run iperf3-srv_10.42.42.10(pid=14544): Terminating (SIGTERM) 18:08:08.258050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminating (SIGTERM) 18:08:08.300883 run iperf3-srv_10.42.42.10(pid=14546): Terminating (SIGTERM) 18:08:08.343815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Terminating (SIGTERM) 18:08:08.386669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Terminating (SIGTERM) 18:08:08.429468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Terminating (SIGTERM) 18:08:08.472317 --- ParallelTerminationStrategy: PID 14543 died... 18:08:08.493016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminated: ok {rc=0} 18:08:08.540189 --- ParallelTerminationStrategy: PID 14544 died... 18:08:08.560264 run iperf3-srv_10.42.42.10(pid=14544): Terminated {rc=256} 18:08:08.607052 --- ParallelTerminationStrategy: PID 14545 died... 18:08:08.627161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminated: ok {rc=0} 18:08:08.674304 --- ParallelTerminationStrategy: PID 14546 died... 18:08:08.694420 run iperf3-srv_10.42.42.10(pid=14546): Terminated {rc=256} 18:08:08.741378 --- ParallelTerminationStrategy: PID 14549 died... 18:08:08.761480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Terminated: ok {rc=0} 18:08:08.808468 --- ParallelTerminationStrategy: PID 14552 died... 18:08:08.828709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Terminated: ok {rc=0} 18:08:08.875770 --- ParallelTerminationStrategy: PID 14555 died... 18:08:08.895971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Terminated: ok {rc=0} 18:08:08.985952 bus /gobi_0: Setting Powered False 18:08:10.086087 bus /gobi_0: Setting Powered False 18:08:11.204020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:08:12.354949 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.367172 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:12.415546 tst iperf3.py: using LAC 35341 18:08:12.536110 tst iperf3.py: using RAC 151 18:08:12.658705 tst iperf3.py: using CellId 35341 18:08:12.780175 tst iperf3.py: using BVCI 35342 18:08:12.891466 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.902695 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.913710 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.924329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.935142 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.946027 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.956888 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.967601 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:12.978569 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:13.099213 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:13.320115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:13.648689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14557): Launched 18:08:13.935755 run iperf3-srv_10.42.42.10(pid=14558): Launched 18:08:14.058210 tst iperf3.py:8: start network... 18:08:14.279037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:14.784333 run create_hlr_db(pid=14559): Launched 18:08:14.910332 bus /gobi_6: Setting Powered False 18:08:15.974797 run create_hlr_db(pid=14559): Terminated: ok {rc=0} 18:08:16.546776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14561): Launched 18:08:16.907092 run osmo-hlr_10.42.42.2(pid=14562): Launched 18:08:17.143178 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:17.779319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14564): Launched 18:08:18.106903 run osmo-stp_10.42.42.5(pid=14565): Launched 18:08:18.233435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:18.793434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14567): Launched 18:08:18.918942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:19.197013 run patchelf(pid=14568): Launched 18:08:19.380426 run osmo-stp_10.42.42.5(pid=14565): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14565)] 18:08:19.518981 run osmo-stp_10.42.42.5(pid=14565): stdout: | (launched: 2022-12-13_18:08:18.046671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:19.659386 run osmo-stp_10.42.42.5(pid=14565): stderr: | [0;m[38;5;43m20221213180818237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180818237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180818238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180818238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180818238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180818239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180818239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:19.799761 run osmo-stp_10.42.42.5(pid=14565): stdout: | (launched: 2022-12-13_18:08:18.046671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:19.933615 run osmo-stp_10.42.42.5(pid=14565): stderr: | [0;m[38;5;43m20221213180818237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180818237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180818238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180818238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180818238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180818239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180818239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:20.092115 run patchelf(pid=14568): Terminating (SIGINT) 18:08:20.278792 run patchelf(pid=14568): Terminated: ok {rc=0} 18:08:20.412358 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14565): Process ended prematurely: osmo-stp_10.42.42.5(pid=14565) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14565)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 18:08:20.422790 tst iperf3.py:8: Test FAILED (8.1 sec) 18:08:20.451464 run osmo-hlr_10.42.42.2(pid=14562): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14562)] 18:08:20.503078 run osmo-hlr_10.42.42.2(pid=14562): stdout: | (launched: 2022-12-13_18:08:16.848466) 18:08:20.555895 run osmo-hlr_10.42.42.2(pid=14562): stderr: | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180817190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180817210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180817223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180817223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180817223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:20.609532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14557): Terminating (SIGTERM) 18:08:20.651844 run iperf3-srv_10.42.42.10(pid=14558): Terminating (SIGTERM) 18:08:20.694636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14561): Terminating (SIGTERM) 18:08:20.737485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14564): Terminating (SIGTERM) 18:08:20.780033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14567): Terminating (SIGTERM) 18:08:20.822860 --- ParallelTerminationStrategy: PID 14557 died... 18:08:20.843413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14557): Terminated: ok {rc=0} 18:08:20.890667 --- ParallelTerminationStrategy: PID 14558 died... 18:08:20.910740 run iperf3-srv_10.42.42.10(pid=14558): Terminated {rc=256} 18:08:20.957508 --- ParallelTerminationStrategy: PID 14561 died... 18:08:20.977760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14561): Terminated: ok {rc=0} 18:08:21.024534 --- ParallelTerminationStrategy: PID 14564 died... 18:08:21.044643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14564): Terminated: ok {rc=0} 18:08:21.091603 --- ParallelTerminationStrategy: PID 14567 died... 18:08:21.111889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14567): Terminated: ok {rc=0} 18:08:21.201559 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:08:22.353304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.365762 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:22.414554 tst iperf3m4.py: using LAC 35342 18:08:22.543955 tst iperf3m4.py: using RAC 152 18:08:22.672398 tst iperf3m4.py: using CellId 35342 18:08:22.801189 tst iperf3m4.py: using BVCI 35343 18:08:22.921163 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.932868 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.944284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.955663 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.967425 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.979215 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:22.991122 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:23.002971 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:23.014987 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:23.144906 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:23.264311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:23.386711 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:23.504718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:23.710135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:24.018461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14569): Launched 18:08:24.287657 run iperf3-srv_10.42.42.10(pid=14570): Launched 18:08:24.402488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:08:24.607279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:24.915464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14571): Launched 18:08:25.182647 run iperf3-srv_10.42.42.10(pid=14572): Launched 18:08:25.296854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:08:25.501557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:25.809622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14573): Launched 18:08:26.078209 run iperf3-srv_10.42.42.10(pid=14574): Launched 18:08:26.194375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:08:26.399294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:26.706585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14575): Launched 18:08:26.975647 run iperf3-srv_10.42.42.10(pid=14576): Launched 18:08:27.089613 tst iperf3m4.py:8: start network... 18:08:27.294285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:27.769059 run create_hlr_db(pid=14577): Launched 18:08:27.894221 bus /gobi_6: Setting Powered False 18:08:28.954982 run create_hlr_db(pid=14577): Terminated: ok {rc=0} 18:08:29.404042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14579): Launched 18:08:29.731266 run osmo-hlr_10.42.42.2(pid=14580): Launched 18:08:29.857428 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:30.427687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14582): Launched 18:08:30.755413 run osmo-stp_10.42.42.5(pid=14583): Launched 18:08:30.947744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:31.574067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14585): Launched 18:08:31.709758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:31.977290 run patchelf(pid=14586): Launched 18:08:32.169230 run osmo-stp_10.42.42.5(pid=14583): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14583)] 18:08:32.301423 run osmo-stp_10.42.42.5(pid=14583): stdout: | (launched: 2022-12-13_18:08:30.695369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:32.433180 run osmo-stp_10.42.42.5(pid=14583): stderr: | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180830883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:32.565368 run osmo-stp_10.42.42.5(pid=14583): stdout: | (launched: 2022-12-13_18:08:30.695369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:32.690711 run osmo-stp_10.42.42.5(pid=14583): stderr: | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180830883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180830883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180830884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:32.839663 run patchelf(pid=14586): Terminating (SIGINT) 18:08:33.014144 run patchelf(pid=14586): Terminated: ok {rc=0} 18:08:33.140390 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14583): Process ended prematurely: osmo-stp_10.42.42.5(pid=14583) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14583)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 18:08:33.150418 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:08:33.178227 run osmo-hlr_10.42.42.2(pid=14580): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14580)] 18:08:33.226660 run osmo-hlr_10.42.42.2(pid=14580): stdout: | (launched: 2022-12-13_18:08:29.671068) 18:08:33.276771 run osmo-hlr_10.42.42.2(pid=14580): stderr: | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180829868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180829884 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180829895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180829895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180829895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:33.327548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14569): Terminating (SIGTERM) 18:08:33.367697 run iperf3-srv_10.42.42.10(pid=14570): Terminating (SIGTERM) 18:08:33.407874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14571): Terminating (SIGTERM) 18:08:33.448128 run iperf3-srv_10.42.42.10(pid=14572): Terminating (SIGTERM) 18:08:33.488246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14573): Terminating (SIGTERM) 18:08:33.528411 run iperf3-srv_10.42.42.10(pid=14574): Terminating (SIGTERM) 18:08:33.568426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14575): Terminating (SIGTERM) 18:08:33.608629 run iperf3-srv_10.42.42.10(pid=14576): Terminating (SIGTERM) 18:08:33.648537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14579): Terminating (SIGTERM) 18:08:33.688675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14582): Terminating (SIGTERM) 18:08:33.728627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14585): Terminating (SIGTERM) 18:08:33.769073 --- ParallelTerminationStrategy: PID 14569 died... 18:08:33.788434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14569): Terminated: ok {rc=0} 18:08:33.832911 --- ParallelTerminationStrategy: PID 14570 died... 18:08:33.851897 run iperf3-srv_10.42.42.10(pid=14570): Terminated {rc=256} 18:08:33.896297 --- ParallelTerminationStrategy: PID 14571 died... 18:08:33.915205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14571): Terminated: ok {rc=0} 18:08:33.959712 --- ParallelTerminationStrategy: PID 14572 died... 18:08:33.978675 run iperf3-srv_10.42.42.10(pid=14572): Terminated {rc=256} 18:08:34.023243 --- ParallelTerminationStrategy: PID 14573 died... 18:08:34.042700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14573): Terminated: ok {rc=0} 18:08:34.087360 --- ParallelTerminationStrategy: PID 14574 died... 18:08:34.106353 run iperf3-srv_10.42.42.10(pid=14574): Terminated {rc=256} 18:08:34.150803 --- ParallelTerminationStrategy: PID 14575 died... 18:08:34.170327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14575): Terminated: ok {rc=0} 18:08:34.214832 --- ParallelTerminationStrategy: PID 14576 died... 18:08:34.233953 run iperf3-srv_10.42.42.10(pid=14576): Terminated {rc=256} 18:08:34.278320 --- ParallelTerminationStrategy: PID 14579 died... 18:08:34.297734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14579): Terminated: ok {rc=0} 18:08:34.342578 --- ParallelTerminationStrategy: PID 14582 died... 18:08:34.361687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14582): Terminated: ok {rc=0} 18:08:34.406101 --- ParallelTerminationStrategy: PID 14585 died... 18:08:34.425210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14585): Terminated: ok {rc=0} 18:08:34.512608 bus /gobi_4: Setting Powered False 18:08:35.613919 bus /gobi_4: Setting Powered False 18:08:36.732249 bus /gobi_1: Setting Powered False 18:08:37.832525 bus /gobi_1: Setting Powered False 18:08:38.949147 bus /gobi_0: Setting Powered False 18:08:40.049401 bus /gobi_0: Setting Powered False 18:08:41.166558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 18:08:42.271041 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.282984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:42.329341 tst ping.py: using LAC 35343 18:08:42.449381 tst ping.py: using RAC 153 18:08:42.566362 tst ping.py: using CellId 35343 18:08:42.685612 tst ping.py: using BVCI 35344 18:08:42.794319 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.805686 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.816610 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.827750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.838771 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.849589 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.860409 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:42.871241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:42.991260 tst ping.py:19: start network... 18:08:43.208521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:43.703698 run create_hlr_db(pid=14587): Launched 18:08:43.825896 bus /gobi_6: Setting Powered False 18:08:44.889246 run create_hlr_db(pid=14587): Terminated: ok {rc=0} 18:08:45.319559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Launched 18:08:45.619966 run osmo-hlr_10.42.42.2(pid=14590): Launched 18:08:45.734271 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:46.371122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Launched 18:08:46.712433 run osmo-stp_10.42.42.5(pid=14593): Launched 18:08:47.043702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:47.685399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14605): Launched 18:08:47.827843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:48.108500 run patchelf(pid=14607): Launched 18:08:48.303232 run osmo-stp_10.42.42.5(pid=14593): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] 18:08:48.443031 run osmo-stp_10.42.42.5(pid=14593): stdout: | (launched: 2022-12-13_18:08:46.649974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:48.585820 run osmo-stp_10.42.42.5(pid=14593): stderr: | [0;m[38;5;43m20221213180846874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180846874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180846875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180846877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:48.730061 run osmo-stp_10.42.42.5(pid=14593): stdout: | (launched: 2022-12-13_18:08:46.649974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:48.865725 run osmo-stp_10.42.42.5(pid=14593): stderr: | [0;m[38;5;43m20221213180846874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180846874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180846875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180846877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180846877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:49.027040 run patchelf(pid=14607): Terminating (SIGINT) 18:08:49.213850 run patchelf(pid=14607): Terminated: ok {rc=0} 18:08:49.349545 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14593): Process ended prematurely: osmo-stp_10.42.42.5(pid=14593) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 18:08:49.359870 tst ping.py:22: Test FAILED (7.1 sec) 18:08:49.389445 run osmo-hlr_10.42.42.2(pid=14590): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14590)] 18:08:49.445389 run osmo-hlr_10.42.42.2(pid=14590): stdout: | (launched: 2022-12-13_18:08:45.564315) 18:08:49.501807 run osmo-hlr_10.42.42.2(pid=14590): stderr: | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180845739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180845751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180845760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180845760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180845760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:49.558990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Terminating (SIGTERM) 18:08:49.603872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Terminating (SIGTERM) 18:08:49.651944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14605): Terminating (SIGTERM) 18:08:49.700419 --- ParallelTerminationStrategy: PID 14589 died... 18:08:49.723175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Terminated: ok {rc=0} 18:08:49.774239 --- ParallelTerminationStrategy: PID 14592 died... 18:08:49.795777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Terminated: ok {rc=0} 18:08:49.845183 --- ParallelTerminationStrategy: PID 14605 died... 18:08:49.866563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14605): Terminated: ok {rc=0} 18:08:49.961521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:08:51.055235 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.068652 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:51.121125 tst ping_idle_ping.py: using LAC 35344 18:08:51.249427 tst ping_idle_ping.py: using RAC 154 18:08:51.378028 tst ping_idle_ping.py: using CellId 35344 18:08:51.512597 tst ping_idle_ping.py: using BVCI 35345 18:08:51.633170 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.645750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.658486 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.670829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.684068 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.697396 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.711577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:51.724643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:51.852794 tst ping_idle_ping.py:24: start network... 18:08:52.075865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:52.592598 run create_hlr_db(pid=14610): Launched 18:08:52.758072 bus /gobi_6: Setting Powered False 18:08:53.836662 run create_hlr_db(pid=14610): Terminated: ok {rc=0} 18:08:54.376592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Launched 18:08:54.704086 run osmo-hlr_10.42.42.2(pid=14872): Launched 18:08:54.953542 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:55.616333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Launched 18:08:55.958358 run osmo-stp_10.42.42.5(pid=14875): Launched 18:08:56.203394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:56.853048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Launched 18:08:56.990572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:57.272387 run patchelf(pid=14878): Launched 18:08:57.467931 run osmo-stp_10.42.42.5(pid=14875): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] 18:08:57.611527 run osmo-stp_10.42.42.5(pid=14875): stdout: | (launched: 2022-12-13_18:08:55.897739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:57.756830 run osmo-stp_10.42.42.5(pid=14875): stderr: | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180856186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:57.900317 run osmo-stp_10.42.42.5(pid=14875): stdout: | (launched: 2022-12-13_18:08:55.897739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:58.039173 run osmo-stp_10.42.42.5(pid=14875): stderr: | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180856185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180856186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180856186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:58.201510 run patchelf(pid=14878): Terminating (SIGINT) 18:08:58.391672 run patchelf(pid=14878): Terminated: ok {rc=0} 18:08:58.528063 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14875): Process ended prematurely: osmo-stp_10.42.42.5(pid=14875) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 18:08:58.539017 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 18:08:58.569257 run osmo-hlr_10.42.42.2(pid=14872): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14872)] 18:08:58.625315 run osmo-hlr_10.42.42.2(pid=14872): stdout: | (launched: 2022-12-13_18:08:54.646376) 18:08:58.681689 run osmo-hlr_10.42.42.2(pid=14872): stderr: | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180854944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180854967 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180854976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180854976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180854976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:58.738750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminating (SIGTERM) 18:08:58.783709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Terminating (SIGTERM) 18:08:58.831191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Terminating (SIGTERM) 18:08:58.878965 --- ParallelTerminationStrategy: PID 14870 died... 18:08:58.901451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminated: ok {rc=0} 18:08:58.952673 --- ParallelTerminationStrategy: PID 14874 died... 18:08:58.974601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Terminated: ok {rc=0} 18:08:59.024443 --- ParallelTerminationStrategy: PID 14877 died... 18:08:59.047174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Terminated: ok {rc=0} 18:08:59.141816 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:09:00.458212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:00.465817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:09:00.499665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:09:00.544315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:09:00.635779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:09:00.667799 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:09:00.713583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:09:01.388486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:09:01.460593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:01.476900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:01.560365 tst cs_paging_gprs_active.py: using LAC 35345 18:09:01.704346 tst cs_paging_gprs_active.py: using RAC 155 18:09:01.891827 tst cs_paging_gprs_active.py: using CellId 35345 18:09:02.026878 tst cs_paging_gprs_active.py: using BVCI 35346 18:09:02.200431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.214192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.226899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.239607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.253279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.266532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.279823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.293036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:02.308779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:02.441155 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:02.587250 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:09:02.818320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:03.159189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14882): Launched 18:09:03.454318 run iperf3-srv_10.42.42.10(pid=14883): Launched 18:09:03.597994 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:09:03.829091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:04.174645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14884): Launched 18:09:04.482581 run iperf3-srv_10.42.42.10(pid=14885): Launched 18:09:04.625125 tst cs_paging_gprs_active.py:38: start network... 18:09:04.856436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:05.386393 run create_hlr_db(pid=14886): Launched 18:09:05.555082 bus /gobi_6: Setting Powered False 18:09:06.622332 run create_hlr_db(pid=14886): Terminated: ok {rc=0} 18:09:07.098653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14888): Launched 18:09:07.452269 run osmo-hlr_10.42.42.2(pid=14889): Launched 18:09:07.709619 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:08.397312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14891): Launched 18:09:08.752445 run osmo-stp_10.42.42.5(pid=14892): Launched 18:09:09.002633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:09.669974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14894): Launched 18:09:09.812312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:10.097463 run patchelf(pid=14896): Launched 18:09:10.271398 run osmo-stp_10.42.42.5(pid=14892): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14892)] 18:09:10.403047 run osmo-stp_10.42.42.5(pid=14892): stdout: | (launched: 2022-12-13_18:09:08.689889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:10.536477 run osmo-stp_10.42.42.5(pid=14892): stderr: | [0;m[38;5;43m20221213180908985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180908985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180908986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180908986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180908986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180908987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180908987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:10.670245 run osmo-stp_10.42.42.5(pid=14892): stdout: | (launched: 2022-12-13_18:09:08.689889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:10.797328 run osmo-stp_10.42.42.5(pid=14892): stderr: | [0;m[38;5;43m20221213180908985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180908985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180908986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180908986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180908986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180908987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180908987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:10.947600 run patchelf(pid=14896): Terminating (SIGINT) 18:09:11.124293 run patchelf(pid=14896): Terminated: ok {rc=0} 18:09:11.251821 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14892): Process ended prematurely: osmo-stp_10.42.42.5(pid=14892) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14892)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:09:11.261458 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 18:09:11.288852 run osmo-hlr_10.42.42.2(pid=14889): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14889)] 18:09:11.337232 run osmo-hlr_10.42.42.2(pid=14889): stdout: | (launched: 2022-12-13_18:09:07.390595) 18:09:11.387461 run osmo-hlr_10.42.42.2(pid=14889): stderr: | [0;m[1;31m20221213180907696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180907696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180907696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180907696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180907696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180907697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180907715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180907723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180907723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180907723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:11.438057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14882): Terminating (SIGTERM) 18:09:11.478628 run iperf3-srv_10.42.42.10(pid=14883): Terminating (SIGTERM) 18:09:11.519052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14884): Terminating (SIGTERM) 18:09:11.559500 run iperf3-srv_10.42.42.10(pid=14885): Terminating (SIGTERM) 18:09:11.599669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14888): Terminating (SIGTERM) 18:09:11.640274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14891): Terminating (SIGTERM) 18:09:11.680748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14894): Terminating (SIGTERM) 18:09:11.721166 --- ParallelTerminationStrategy: PID 14882 died... 18:09:11.740594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14882): Terminated: ok {rc=0} 18:09:11.785327 --- ParallelTerminationStrategy: PID 14883 died... 18:09:11.804227 run iperf3-srv_10.42.42.10(pid=14883): Terminated {rc=256} 18:09:11.849529 --- ParallelTerminationStrategy: PID 14884 died... 18:09:11.868509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14884): Terminated: ok {rc=0} 18:09:11.913117 --- ParallelTerminationStrategy: PID 14885 died... 18:09:11.931951 run iperf3-srv_10.42.42.10(pid=14885): Terminated {rc=256} 18:09:11.976400 --- ParallelTerminationStrategy: PID 14888 died... 18:09:11.995517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14888): Terminated: ok {rc=0} 18:09:12.040215 --- ParallelTerminationStrategy: PID 14891 died... 18:09:12.059265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14891): Terminated: ok {rc=0} 18:09:12.103721 --- ParallelTerminationStrategy: PID 14894 died... 18:09:12.122819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14894): Terminated: ok {rc=0} 18:09:12.208487 bus /gobi_0: Setting Powered False 18:09:13.306674 bus /gobi_0: Setting Powered False 18:09:14.423987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:09:15.579234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:15.591525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:15.662467 tst iperf3.py: using LAC 35346 18:09:15.793029 tst iperf3.py: using RAC 156 18:09:15.923910 tst iperf3.py: using CellId 35346 18:09:16.049494 tst iperf3.py: using BVCI 35347 18:09:16.178699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.190930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.203466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.216005 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.229640 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.243235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.256711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.269993 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:16.283258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:16.416424 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:16.648656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:16.993756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14897): Launched 18:09:17.278547 run iperf3-srv_10.42.42.10(pid=14898): Launched 18:09:17.396261 tst iperf3.py:8: start network... 18:09:17.603484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:18.081157 run create_hlr_db(pid=14899): Launched 18:09:18.206740 bus /gobi_6: Setting Powered False 18:09:19.267692 run create_hlr_db(pid=14899): Terminated: ok {rc=0} 18:09:19.718001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14901): Launched 18:09:20.047342 run osmo-hlr_10.42.42.2(pid=14902): Launched 18:09:20.174298 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:20.750023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14904): Launched 18:09:21.078491 run osmo-stp_10.42.42.5(pid=14905): Launched 18:09:21.205521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:21.773472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14907): Launched 18:09:21.901648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:22.181716 run patchelf(pid=14908): Launched 18:09:22.366974 run osmo-stp_10.42.42.5(pid=14905): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14905)] 18:09:22.507502 run osmo-stp_10.42.42.5(pid=14905): stdout: | (launched: 2022-12-13_18:09:21.017839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:22.648730 run osmo-stp_10.42.42.5(pid=14905): stderr: | [0;m[38;5;43m20221213180921211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180921211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180921212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180921212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:22.790983 run osmo-stp_10.42.42.5(pid=14905): stdout: | (launched: 2022-12-13_18:09:21.017839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:22.926314 run osmo-stp_10.42.42.5(pid=14905): stderr: | [0;m[38;5;43m20221213180921211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180921211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180921212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180921212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180921213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:23.086401 run patchelf(pid=14908): Terminating (SIGINT) 18:09:23.274696 run patchelf(pid=14908): Terminated: ok {rc=0} 18:09:23.409846 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14905): Process ended prematurely: osmo-stp_10.42.42.5(pid=14905) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14905)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 18:09:23.420202 tst iperf3.py:8: Test FAILED (7.9 sec) 18:09:23.449276 run osmo-hlr_10.42.42.2(pid=14902): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14902)] 18:09:23.500760 run osmo-hlr_10.42.42.2(pid=14902): stdout: | (launched: 2022-12-13_18:09:19.986558) 18:09:23.554373 run osmo-hlr_10.42.42.2(pid=14902): stderr: | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180920186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180920199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180920207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180920208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180920208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:23.607948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14897): Terminating (SIGTERM) 18:09:23.650647 run iperf3-srv_10.42.42.10(pid=14898): Terminating (SIGTERM) 18:09:23.694316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14901): Terminating (SIGTERM) 18:09:23.737675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14904): Terminating (SIGTERM) 18:09:23.778043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14907): Terminating (SIGTERM) 18:09:23.818441 --- ParallelTerminationStrategy: PID 14897 died... 18:09:23.838052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14897): Terminated: ok {rc=0} 18:09:23.882954 --- ParallelTerminationStrategy: PID 14898 died... 18:09:23.902138 run iperf3-srv_10.42.42.10(pid=14898): Terminated {rc=256} 18:09:23.946806 --- ParallelTerminationStrategy: PID 14901 died... 18:09:23.965981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14901): Terminated: ok {rc=0} 18:09:24.010433 --- ParallelTerminationStrategy: PID 14904 died... 18:09:24.029921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14904): Terminated: ok {rc=0} 18:09:24.074308 --- ParallelTerminationStrategy: PID 14907 died... 18:09:24.093504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14907): Terminated: ok {rc=0} 18:09:24.181122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:09:25.331055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.343042 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:25.409982 tst iperf3m4.py: using LAC 35347 18:09:25.532927 tst iperf3m4.py: using RAC 157 18:09:25.655319 tst iperf3m4.py: using CellId 35347 18:09:25.778339 tst iperf3m4.py: using BVCI 35348 18:09:25.891007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.902151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.913095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.923881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.934944 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.946093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.957260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.968254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:25.979356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:26.101921 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:26.224204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:26.348106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:26.470872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:26.693289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:27.023612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14909): Launched 18:09:27.313604 run iperf3-srv_10.42.42.10(pid=14910): Launched 18:09:27.437796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:09:27.660929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:27.992874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Launched 18:09:28.282414 run iperf3-srv_10.42.42.10(pid=14912): Launched 18:09:28.405738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:09:28.627671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:28.958795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14913): Launched 18:09:29.246621 run iperf3-srv_10.42.42.10(pid=14914): Launched 18:09:29.369719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:09:29.591030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:29.921623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14915): Launched 18:09:30.210102 run iperf3-srv_10.42.42.10(pid=14916): Launched 18:09:30.334694 tst iperf3m4.py:8: start network... 18:09:30.555688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:31.090114 run create_hlr_db(pid=14917): Launched 18:09:31.254931 bus /gobi_6: Setting Powered False 18:09:32.314953 run create_hlr_db(pid=14917): Terminated: ok {rc=0} 18:09:32.759804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14919): Launched 18:09:33.069603 run osmo-hlr_10.42.42.2(pid=14920): Launched 18:09:33.187381 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:33.721744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14922): Launched 18:09:34.031285 run osmo-stp_10.42.42.5(pid=14923): Launched 18:09:34.148481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:34.680735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14925): Launched 18:09:34.800358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:35.061844 run patchelf(pid=14926): Launched 18:09:35.234295 run osmo-stp_10.42.42.5(pid=14923): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14923)] 18:09:35.365337 run osmo-stp_10.42.42.5(pid=14923): stdout: | (launched: 2022-12-13_18:09:33.973157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:35.497825 run osmo-stp_10.42.42.5(pid=14923): stderr: | [0;m[38;5;43m20221213180934143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180934143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180934144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180934144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:35.629959 run osmo-stp_10.42.42.5(pid=14923): stdout: | (launched: 2022-12-13_18:09:33.973157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:35.755973 run osmo-stp_10.42.42.5(pid=14923): stderr: | [0;m[38;5;43m20221213180934143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180934143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180934144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180934144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180934145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:35.905631 run patchelf(pid=14926): Terminating (SIGINT) 18:09:36.081264 run patchelf(pid=14926): Terminated: ok {rc=0} 18:09:36.207637 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14923): Process ended prematurely: osmo-stp_10.42.42.5(pid=14923) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14923)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:09:36.217243 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:09:36.244646 run osmo-hlr_10.42.42.2(pid=14920): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14920)] 18:09:36.292719 run osmo-hlr_10.42.42.2(pid=14920): stdout: | (launched: 2022-12-13_18:09:33.011998) 18:09:36.342716 run osmo-hlr_10.42.42.2(pid=14920): stderr: | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180933189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180933202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180933210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180933210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180933210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:36.392871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14909): Terminating (SIGTERM) 18:09:36.433037 run iperf3-srv_10.42.42.10(pid=14910): Terminating (SIGTERM) 18:09:36.473593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Terminating (SIGTERM) 18:09:36.513827 run iperf3-srv_10.42.42.10(pid=14912): Terminating (SIGTERM) 18:09:36.553871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14913): Terminating (SIGTERM) 18:09:36.593867 run iperf3-srv_10.42.42.10(pid=14914): Terminating (SIGTERM) 18:09:36.634425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14915): Terminating (SIGTERM) 18:09:36.674795 run iperf3-srv_10.42.42.10(pid=14916): Terminating (SIGTERM) 18:09:36.714339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14919): Terminating (SIGTERM) 18:09:36.754482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14922): Terminating (SIGTERM) 18:09:36.794845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14925): Terminating (SIGTERM) 18:09:36.834909 --- ParallelTerminationStrategy: PID 14909 died... 18:09:36.854084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14909): Terminated: ok {rc=0} 18:09:36.898103 --- ParallelTerminationStrategy: PID 14910 died... 18:09:36.916787 run iperf3-srv_10.42.42.10(pid=14910): Terminated {rc=256} 18:09:36.960671 --- ParallelTerminationStrategy: PID 14911 died... 18:09:36.979364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Terminated: ok {rc=0} 18:09:37.023171 --- ParallelTerminationStrategy: PID 14912 died... 18:09:37.041713 run iperf3-srv_10.42.42.10(pid=14912): Terminated {rc=256} 18:09:37.085532 --- ParallelTerminationStrategy: PID 14913 died... 18:09:37.104154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14913): Terminated: ok {rc=0} 18:09:37.148196 --- ParallelTerminationStrategy: PID 14914 died... 18:09:37.166940 run iperf3-srv_10.42.42.10(pid=14914): Terminated {rc=256} 18:09:37.210860 --- ParallelTerminationStrategy: PID 14915 died... 18:09:37.229517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14915): Terminated: ok {rc=0} 18:09:37.273477 --- ParallelTerminationStrategy: PID 14916 died... 18:09:37.292191 run iperf3-srv_10.42.42.10(pid=14916): Terminated {rc=256} 18:09:37.335971 --- ParallelTerminationStrategy: PID 14919 died... 18:09:37.354723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14919): Terminated: ok {rc=0} 18:09:37.398637 --- ParallelTerminationStrategy: PID 14922 died... 18:09:37.417370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14922): Terminated: ok {rc=0} 18:09:37.461361 --- ParallelTerminationStrategy: PID 14925 died... 18:09:37.480055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14925): Terminated: ok {rc=0} 18:09:37.567051 bus /gobi_4: Setting Powered False 18:09:38.668124 bus /gobi_4: Setting Powered False 18:09:39.786067 bus /gobi_1: Setting Powered False 18:09:40.885673 bus /gobi_1: Setting Powered False 18:09:42.002684 bus /gobi_0: Setting Powered False 18:09:43.102166 bus /gobi_0: Setting Powered False 18:09:44.223771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:09:45.327794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.339682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:45.406622 tst ping.py: using LAC 35348 18:09:45.526508 tst ping.py: using RAC 158 18:09:45.652741 tst ping.py: using CellId 35348 18:09:45.780916 tst ping.py: using BVCI 35349 18:09:45.919021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.931090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.942645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.954433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.966167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.977896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:45.990288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:46.002540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:46.125055 tst ping.py:19: start network... 18:09:46.357468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:46.839421 run create_hlr_db(pid=14928): Launched 18:09:46.999282 bus /gobi_6: Setting Powered False 18:09:48.059315 run create_hlr_db(pid=14928): Terminated: ok {rc=0} 18:09:48.482098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Launched 18:09:48.784009 run osmo-hlr_10.42.42.2(pid=14931): Launched 18:09:48.899463 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:49.438244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Launched 18:09:49.739933 run osmo-stp_10.42.42.5(pid=14934): Launched 18:09:49.853815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:50.372312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Launched 18:09:50.488405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:50.743668 run patchelf(pid=14937): Launched 18:09:50.911368 run osmo-stp_10.42.42.5(pid=14934): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] 18:09:51.038888 run osmo-stp_10.42.42.5(pid=14934): stdout: | (launched: 2022-12-13_18:09:49.683138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:51.168164 run osmo-stp_10.42.42.5(pid=14934): stderr: | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180949856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:51.297427 run osmo-stp_10.42.42.5(pid=14934): stdout: | (launched: 2022-12-13_18:09:49.683138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:51.420366 run osmo-stp_10.42.42.5(pid=14934): stderr: | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180949855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180949856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180949856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:51.566430 run patchelf(pid=14937): Terminating (SIGINT) 18:09:51.737106 run patchelf(pid=14937): Terminated: ok {rc=0} 18:09:51.860035 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14934): Process ended prematurely: osmo-stp_10.42.42.5(pid=14934) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 18:09:51.868908 tst ping.py:22: Test FAILED (6.5 sec) 18:09:51.895852 run osmo-hlr_10.42.42.2(pid=14931): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14931)] 18:09:51.944311 run osmo-hlr_10.42.42.2(pid=14931): stdout: | (launched: 2022-12-13_18:09:48.727695) 18:09:51.994234 run osmo-hlr_10.42.42.2(pid=14931): stderr: | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180948905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180948918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180948928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180948929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180948929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:52.044587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Terminating (SIGTERM) 18:09:52.084821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Terminating (SIGTERM) 18:09:52.125850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Terminating (SIGTERM) 18:09:52.166507 --- ParallelTerminationStrategy: PID 14930 died... 18:09:52.186093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Terminated: ok {rc=0} 18:09:52.230543 --- ParallelTerminationStrategy: PID 14933 died... 18:09:52.249479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Terminated: ok {rc=0} 18:09:52.293775 --- ParallelTerminationStrategy: PID 14936 died... 18:09:52.312593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Terminated: ok {rc=0} 18:09:52.396638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:09:53.484411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:53.496794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:53.569032 tst ping_idle_ping.py: using LAC 35349 18:09:53.696095 tst ping_idle_ping.py: using RAC 159 18:09:53.822503 tst ping_idle_ping.py: using CellId 35349 18:09:53.948414 tst ping_idle_ping.py: using BVCI 35350 18:09:54.068440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.080204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.091634 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.103185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.115428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.127715 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.140029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:54.152248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:54.274795 tst ping_idle_ping.py:24: start network... 18:09:54.494364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:54.999135 run create_hlr_db(pid=14938): Launched 18:09:55.122788 bus /gobi_6: Setting Powered False 18:09:56.186701 run create_hlr_db(pid=14938): Terminated: ok {rc=0} 18:09:56.622680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Launched 18:09:56.926483 run osmo-hlr_10.42.42.2(pid=14941): Launched 18:09:57.042325 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:57.565461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Launched 18:09:57.870585 run osmo-stp_10.42.42.5(pid=14944): Launched 18:09:57.987644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:58.513534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Launched 18:09:58.629867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:58.888049 run patchelf(pid=14947): Launched 18:09:59.059650 run osmo-stp_10.42.42.5(pid=14944): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] 18:09:59.188583 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-13_18:09:57.813570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:59.319482 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180957986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:59.450391 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-13_18:09:57.813570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:59.574627 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213180957985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213180957986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213180957986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:59.722065 run patchelf(pid=14947): Terminating (SIGINT) 18:09:59.895021 run patchelf(pid=14947): Terminated: ok {rc=0} 18:10:00.019032 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:10:00.027913 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:10:00.055081 run osmo-hlr_10.42.42.2(pid=14941): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14941)] 18:10:00.103119 run osmo-hlr_10.42.42.2(pid=14941): stdout: | (launched: 2022-12-13_18:09:56.869981) 18:10:00.153477 run osmo-hlr_10.42.42.2(pid=14941): stderr: | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213180957044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213180957059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213180957070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213180957070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213180957070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:00.203972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminating (SIGTERM) 18:10:00.244566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminating (SIGTERM) 18:10:00.284897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminating (SIGTERM) 18:10:00.325814 --- ParallelTerminationStrategy: PID 14940 died... 18:10:00.345424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminated: ok {rc=0} 18:10:00.390446 --- ParallelTerminationStrategy: PID 14943 died... 18:10:00.409483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminated: ok {rc=0} 18:10:00.454191 --- ParallelTerminationStrategy: PID 14946 died... 18:10:00.473028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminated: ok {rc=0} 18:10:00.560054 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:10:01.877501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:01.883960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:10:01.923736 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:10:01.978224 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:10:02.065560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:10:02.103453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:10:02.152432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:10:02.729477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:10:02.780123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:02.791418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:02.857661 tst cs_paging_gprs_active.py: using LAC 35350 18:10:02.978985 tst cs_paging_gprs_active.py: using RAC 160 18:10:03.102236 tst cs_paging_gprs_active.py: using CellId 35350 18:10:03.224509 tst cs_paging_gprs_active.py: using BVCI 35351 18:10:03.336277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.347459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.358418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.369372 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.380396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.391460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.402449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.413410 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:03.424598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:03.547538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:03.667659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:10:03.875082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:04.186234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14954): Launched 18:10:04.459654 run iperf3-srv_10.42.42.10(pid=14955): Launched 18:10:04.576759 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:10:04.783479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:05.095740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14956): Launched 18:10:05.368020 run iperf3-srv_10.42.42.10(pid=14957): Launched 18:10:05.485230 tst cs_paging_gprs_active.py:38: start network... 18:10:05.691810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:06.171262 run create_hlr_db(pid=14958): Launched 18:10:06.298850 bus /gobi_6: Setting Powered False 18:10:07.360268 run create_hlr_db(pid=14958): Terminated: ok {rc=0} 18:10:07.791343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14960): Launched 18:10:08.104091 run osmo-hlr_10.42.42.2(pid=14961): Launched 18:10:08.222031 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:08.767187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14963): Launched 18:10:09.080602 run osmo-stp_10.42.42.5(pid=14964): Launched 18:10:09.199184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:09.732158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14966): Launched 18:10:09.853128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:10.124043 run patchelf(pid=14967): Launched 18:10:10.298212 run osmo-stp_10.42.42.5(pid=14964): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14964)] 18:10:10.429494 run osmo-stp_10.42.42.5(pid=14964): stdout: | (launched: 2022-12-13_18:10:09.021964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:10.562700 run osmo-stp_10.42.42.5(pid=14964): stderr: | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181009197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:10.695308 run osmo-stp_10.42.42.5(pid=14964): stdout: | (launched: 2022-12-13_18:10:09.021964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:10.821866 run osmo-stp_10.42.42.5(pid=14964): stderr: | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181009196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181009197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181009197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:10.972001 run patchelf(pid=14967): Terminating (SIGINT) 18:10:11.149162 run patchelf(pid=14967): Terminated: ok {rc=0} 18:10:11.275933 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14964): Process ended prematurely: osmo-stp_10.42.42.5(pid=14964) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14964)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:10:11.285736 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:10:11.313312 run osmo-hlr_10.42.42.2(pid=14961): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14961)] 18:10:11.362266 run osmo-hlr_10.42.42.2(pid=14961): stdout: | (launched: 2022-12-13_18:10:08.046179) 18:10:11.413283 run osmo-hlr_10.42.42.2(pid=14961): stderr: | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181008223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181008235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181008243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181008244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181008244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:11.464023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14954): Terminating (SIGTERM) 18:10:11.504763 run iperf3-srv_10.42.42.10(pid=14955): Terminating (SIGTERM) 18:10:11.545841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14956): Terminating (SIGTERM) 18:10:11.586592 run iperf3-srv_10.42.42.10(pid=14957): Terminating (SIGTERM) 18:10:11.627036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14960): Terminating (SIGTERM) 18:10:11.667609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14963): Terminating (SIGTERM) 18:10:11.708189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14966): Terminating (SIGTERM) 18:10:11.749050 --- ParallelTerminationStrategy: PID 14954 died... 18:10:11.768702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14954): Terminated: ok {rc=0} 18:10:11.813568 --- ParallelTerminationStrategy: PID 14955 died... 18:10:11.832510 run iperf3-srv_10.42.42.10(pid=14955): Terminated {rc=256} 18:10:11.877261 --- ParallelTerminationStrategy: PID 14956 died... 18:10:11.896358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14956): Terminated: ok {rc=0} 18:10:11.941293 --- ParallelTerminationStrategy: PID 14957 died... 18:10:11.960314 run iperf3-srv_10.42.42.10(pid=14957): Terminated {rc=256} 18:10:12.005219 --- ParallelTerminationStrategy: PID 14960 died... 18:10:12.024278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14960): Terminated: ok {rc=0} 18:10:12.069163 --- ParallelTerminationStrategy: PID 14963 died... 18:10:12.088334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14963): Terminated: ok {rc=0} 18:10:12.133211 --- ParallelTerminationStrategy: PID 14966 died... 18:10:12.152300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14966): Terminated: ok {rc=0} 18:10:12.240629 bus /gobi_0: Setting Powered False 18:10:13.343162 bus /gobi_0: Setting Powered False 18:10:14.463041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:10:15.612043 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:15.624019 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:15.691407 tst iperf3.py: using LAC 35351 18:10:15.812050 tst iperf3.py: using RAC 161 18:10:15.978434 tst iperf3.py: using CellId 35351 18:10:16.100822 tst iperf3.py: using BVCI 35352 18:10:16.252274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.264857 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.277966 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.291543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.306080 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.319832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.334725 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.348464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:16.362470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:16.492348 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:10:16.749515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:17.089894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14969): Launched 18:10:17.394039 run iperf3-srv_10.42.42.10(pid=14970): Launched 18:10:17.518435 tst iperf3.py:8: start network... 18:10:17.741156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:18.252179 run create_hlr_db(pid=14971): Launched 18:10:18.378248 bus /gobi_6: Setting Powered False 18:10:19.443041 run create_hlr_db(pid=14971): Terminated: ok {rc=0} 18:10:19.884019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14973): Launched 18:10:20.194612 run osmo-hlr_10.42.42.2(pid=14974): Launched 18:10:20.313873 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:20.847278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14976): Launched 18:10:21.159340 run osmo-stp_10.42.42.5(pid=14977): Launched 18:10:21.277092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:21.810176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14979): Launched 18:10:21.928666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:22.191210 run patchelf(pid=14980): Launched 18:10:22.364865 run osmo-stp_10.42.42.5(pid=14977): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14977)] 18:10:22.495758 run osmo-stp_10.42.42.5(pid=14977): stdout: | (launched: 2022-12-13_18:10:21.101111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:22.628414 run osmo-stp_10.42.42.5(pid=14977): stderr: | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181021274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:22.761298 run osmo-stp_10.42.42.5(pid=14977): stdout: | (launched: 2022-12-13_18:10:21.101111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:22.887536 run osmo-stp_10.42.42.5(pid=14977): stderr: | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181021273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181021274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181021274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:23.036836 run patchelf(pid=14980): Terminating (SIGINT) 18:10:23.213491 run patchelf(pid=14980): Terminated: ok {rc=0} 18:10:23.339610 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14977): Process ended prematurely: osmo-stp_10.42.42.5(pid=14977) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14977)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 18:10:23.349333 tst iperf3.py:8: Test FAILED (7.8 sec) 18:10:23.376655 run osmo-hlr_10.42.42.2(pid=14974): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14974)] 18:10:23.424780 run osmo-hlr_10.42.42.2(pid=14974): stdout: | (launched: 2022-12-13_18:10:20.137071) 18:10:23.475104 run osmo-hlr_10.42.42.2(pid=14974): stderr: | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181020315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181020333 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181020342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181020343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181020343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:23.526018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14969): Terminating (SIGTERM) 18:10:23.566473 run iperf3-srv_10.42.42.10(pid=14970): Terminating (SIGTERM) 18:10:23.607509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14973): Terminating (SIGTERM) 18:10:23.648088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14976): Terminating (SIGTERM) 18:10:23.688721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14979): Terminating (SIGTERM) 18:10:23.729381 --- ParallelTerminationStrategy: PID 14969 died... 18:10:23.748724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14969): Terminated: ok {rc=0} 18:10:23.793629 --- ParallelTerminationStrategy: PID 14970 died... 18:10:23.812467 run iperf3-srv_10.42.42.10(pid=14970): Terminated {rc=256} 18:10:23.857260 --- ParallelTerminationStrategy: PID 14973 died... 18:10:23.875919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14973): Terminated: ok {rc=0} 18:10:23.920571 --- ParallelTerminationStrategy: PID 14976 died... 18:10:23.939606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14976): Terminated: ok {rc=0} 18:10:23.984273 --- ParallelTerminationStrategy: PID 14979 died... 18:10:24.003480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14979): Terminated: ok {rc=0} 18:10:24.091162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:10:25.242157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.254119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:25.321808 tst iperf3m4.py: using LAC 35352 18:10:25.444458 tst iperf3m4.py: using RAC 162 18:10:25.566702 tst iperf3m4.py: using CellId 35352 18:10:25.688738 tst iperf3m4.py: using BVCI 35353 18:10:25.801133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.812252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.823134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.834096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.844925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.855816 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.866799 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.877734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:25.888670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:26.010571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:26.132450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:26.255580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:26.379329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:10:26.601953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:26.933380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14981): Launched 18:10:27.222971 run iperf3-srv_10.42.42.10(pid=14982): Launched 18:10:27.349491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:10:27.571620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:27.903254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14983): Launched 18:10:28.191894 run iperf3-srv_10.42.42.10(pid=14984): Launched 18:10:28.317670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:10:28.540168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:28.872543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14985): Launched 18:10:29.162654 run iperf3-srv_10.42.42.10(pid=14986): Launched 18:10:29.287345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:10:29.510160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:29.842564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Launched 18:10:30.131041 run iperf3-srv_10.42.42.10(pid=14988): Launched 18:10:30.255277 tst iperf3m4.py:8: start network... 18:10:30.477748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:31.007066 run create_hlr_db(pid=14989): Launched 18:10:31.163083 bus /gobi_6: Setting Powered False 18:10:32.222952 run create_hlr_db(pid=14989): Terminated: ok {rc=0} 18:10:32.679164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14991): Launched 18:10:33.011061 run osmo-hlr_10.42.42.2(pid=14992): Launched 18:10:33.138775 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:33.708151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14994): Launched 18:10:34.039544 run osmo-stp_10.42.42.5(pid=14995): Launched 18:10:34.168395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:34.738628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14997): Launched 18:10:34.864708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:35.144804 run patchelf(pid=14998): Launched 18:10:35.331013 run osmo-stp_10.42.42.5(pid=14995): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14995)] 18:10:35.471206 run osmo-stp_10.42.42.5(pid=14995): stdout: | (launched: 2022-12-13_18:10:33.977854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:35.612734 run osmo-stp_10.42.42.5(pid=14995): stderr: | [0;m[38;5;43m20221213181034170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181034170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181034171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181034171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181034171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181034172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181034172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:35.754463 run osmo-stp_10.42.42.5(pid=14995): stdout: | (launched: 2022-12-13_18:10:33.977854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:35.889473 run osmo-stp_10.42.42.5(pid=14995): stderr: | [0;m[38;5;43m20221213181034170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181034170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181034171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181034171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181034171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181034172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181034172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:36.049788 run patchelf(pid=14998): Terminating (SIGINT) 18:10:36.237801 run patchelf(pid=14998): Terminated: ok {rc=0} 18:10:36.372535 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14995): Process ended prematurely: osmo-stp_10.42.42.5(pid=14995) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14995)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:10:36.383180 tst iperf3m4.py:8: Test FAILED (11.2 sec) 18:10:36.412249 run osmo-hlr_10.42.42.2(pid=14992): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14992)] 18:10:36.464421 run osmo-hlr_10.42.42.2(pid=14992): stdout: | (launched: 2022-12-13_18:10:32.949692) 18:10:36.517722 run osmo-hlr_10.42.42.2(pid=14992): stderr: | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181033151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181033181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181033190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181033191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181033191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:36.570977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14981): Terminating (SIGTERM) 18:10:36.613700 run iperf3-srv_10.42.42.10(pid=14982): Terminating (SIGTERM) 18:10:36.656639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14983): Terminating (SIGTERM) 18:10:36.699842 run iperf3-srv_10.42.42.10(pid=14984): Terminating (SIGTERM) 18:10:36.742781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14985): Terminating (SIGTERM) 18:10:36.786012 run iperf3-srv_10.42.42.10(pid=14986): Terminating (SIGTERM) 18:10:36.828867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Terminating (SIGTERM) 18:10:36.872041 run iperf3-srv_10.42.42.10(pid=14988): Terminating (SIGTERM) 18:10:36.914892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14991): Terminating (SIGTERM) 18:10:36.957994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14994): Terminating (SIGTERM) 18:10:37.000789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14997): Terminating (SIGTERM) 18:10:37.044086 --- ParallelTerminationStrategy: PID 14981 died... 18:10:37.065257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14981): Terminated: ok {rc=0} 18:10:37.112799 --- ParallelTerminationStrategy: PID 14982 died... 18:10:37.133581 run iperf3-srv_10.42.42.10(pid=14982): Terminated {rc=256} 18:10:37.181267 --- ParallelTerminationStrategy: PID 14983 died... 18:10:37.201559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14983): Terminated: ok {rc=0} 18:10:37.249148 --- ParallelTerminationStrategy: PID 14984 died... 18:10:37.269545 run iperf3-srv_10.42.42.10(pid=14984): Terminated {rc=256} 18:10:37.316861 --- ParallelTerminationStrategy: PID 14985 died... 18:10:37.337636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14985): Terminated: ok {rc=0} 18:10:37.384812 --- ParallelTerminationStrategy: PID 14986 died... 18:10:37.405763 run iperf3-srv_10.42.42.10(pid=14986): Terminated {rc=256} 18:10:37.452889 --- ParallelTerminationStrategy: PID 14987 died... 18:10:37.473711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Terminated: ok {rc=0} 18:10:37.520740 --- ParallelTerminationStrategy: PID 14988 died... 18:10:37.541138 run iperf3-srv_10.42.42.10(pid=14988): Terminated {rc=256} 18:10:37.588304 --- ParallelTerminationStrategy: PID 14991 died... 18:10:37.608690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14991): Terminated: ok {rc=0} 18:10:37.655645 --- ParallelTerminationStrategy: PID 14994 died... 18:10:37.675898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14994): Terminated: ok {rc=0} 18:10:37.723302 --- ParallelTerminationStrategy: PID 14997 died... 18:10:37.743504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14997): Terminated: ok {rc=0} 18:10:37.833675 bus /gobi_4: Setting Powered False 18:10:38.934829 bus /gobi_4: Setting Powered False 18:10:40.053250 bus /gobi_1: Setting Powered False 18:10:41.153557 bus /gobi_1: Setting Powered False 18:10:42.271368 bus /gobi_0: Setting Powered False 18:10:43.371740 bus /gobi_0: Setting Powered False 18:10:44.490807 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:10:45.596063 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:45.608357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:45.679592 tst ping.py: using LAC 35353 18:10:45.798517 tst ping.py: using RAC 163 18:10:45.945087 tst ping.py: using CellId 35353 18:10:46.073951 tst ping.py: using BVCI 35354 18:10:46.215837 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.227877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.239556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.251160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.262759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.274589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.286441 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:46.298272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:46.417243 tst ping.py:19: start network... 18:10:46.630226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:47.106157 run create_hlr_db(pid=14999): Launched 18:10:47.264265 bus /gobi_6: Setting Powered False 18:10:48.324863 run create_hlr_db(pid=14999): Terminated: ok {rc=0} 18:10:48.747532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Launched 18:10:49.052045 run osmo-hlr_10.42.42.2(pid=15002): Launched 18:10:49.165825 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:49.690434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Launched 18:10:49.993736 run osmo-stp_10.42.42.5(pid=15005): Launched 18:10:50.110424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:50.635168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15007): Launched 18:10:50.750624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:51.007791 run patchelf(pid=15008): Launched 18:10:51.175791 run osmo-stp_10.42.42.5(pid=15005): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] 18:10:51.303739 run osmo-stp_10.42.42.5(pid=15005): stdout: | (launched: 2022-12-13_18:10:49.936888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:51.434646 run osmo-stp_10.42.42.5(pid=15005): stderr: | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181050111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:51.564552 run osmo-stp_10.42.42.5(pid=15005): stdout: | (launched: 2022-12-13_18:10:49.936888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:51.687968 run osmo-stp_10.42.42.5(pid=15005): stderr: | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181050110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181050111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181050111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:51.834817 run patchelf(pid=15008): Terminating (SIGINT) 18:10:52.021042 run patchelf(pid=15008): Terminated: ok {rc=0} 18:10:52.153244 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15005): Process ended prematurely: osmo-stp_10.42.42.5(pid=15005) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 18:10:52.163258 tst ping.py:22: Test FAILED (6.6 sec) 18:10:52.192017 run osmo-hlr_10.42.42.2(pid=15002): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15002)] 18:10:52.244568 run osmo-hlr_10.42.42.2(pid=15002): stdout: | (launched: 2022-12-13_18:10:48.995253) 18:10:52.298068 run osmo-hlr_10.42.42.2(pid=15002): stderr: | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181049173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181049202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181049211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181049211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181049211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:52.352033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Terminating (SIGTERM) 18:10:52.394798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Terminating (SIGTERM) 18:10:52.438028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15007): Terminating (SIGTERM) 18:10:52.481611 --- ParallelTerminationStrategy: PID 15001 died... 18:10:52.502667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Terminated: ok {rc=0} 18:10:52.550616 --- ParallelTerminationStrategy: PID 15004 died... 18:10:52.571490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Terminated: ok {rc=0} 18:10:52.619177 --- ParallelTerminationStrategy: PID 15007 died... 18:10:52.639551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15007): Terminated: ok {rc=0} 18:10:52.730557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:10:53.820086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:53.832402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:53.903168 tst ping_idle_ping.py: using LAC 35354 18:10:54.032531 tst ping_idle_ping.py: using RAC 164 18:10:54.159455 tst ping_idle_ping.py: using CellId 35354 18:10:54.287080 tst ping_idle_ping.py: using BVCI 35355 18:10:54.406928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.418704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.430240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.441720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.453526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.465349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.477218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:54.489017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:54.607841 tst ping_idle_ping.py:24: start network... 18:10:54.811967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:55.283492 run create_hlr_db(pid=15012): Launched 18:10:55.410400 bus /gobi_6: Setting Powered False 18:10:56.471787 run create_hlr_db(pid=15012): Terminated: ok {rc=0} 18:10:56.916217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Launched 18:10:57.244173 run osmo-hlr_10.42.42.2(pid=15015): Launched 18:10:57.371555 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:57.930782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Launched 18:10:58.257482 run osmo-stp_10.42.42.5(pid=15018): Launched 18:10:58.382473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:58.946105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15020): Launched 18:10:59.071011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:59.347335 run patchelf(pid=15021): Launched 18:10:59.529662 run osmo-stp_10.42.42.5(pid=15018): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] 18:10:59.667472 run osmo-stp_10.42.42.5(pid=15018): stdout: | (launched: 2022-12-13_18:10:58.196824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:59.807706 run osmo-stp_10.42.42.5(pid=15018): stderr: | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181058391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:59.947798 run osmo-stp_10.42.42.5(pid=15018): stdout: | (launched: 2022-12-13_18:10:58.196824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:00.081308 run osmo-stp_10.42.42.5(pid=15018): stderr: | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181058390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181058391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181058391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:00.239913 run patchelf(pid=15021): Terminating (SIGINT) 18:11:00.424255 run patchelf(pid=15021): Terminated: ok {rc=0} 18:11:00.556854 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15018): Process ended prematurely: osmo-stp_10.42.42.5(pid=15018) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:11:00.566756 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:11:00.595162 run osmo-hlr_10.42.42.2(pid=15015): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15015)] 18:11:00.646939 run osmo-hlr_10.42.42.2(pid=15015): stdout: | (launched: 2022-12-13_18:10:57.183802) 18:11:00.699787 run osmo-hlr_10.42.42.2(pid=15015): stderr: | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181057383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181057419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181057427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181057428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181057428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:00.753505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Terminating (SIGTERM) 18:11:00.795976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Terminating (SIGTERM) 18:11:00.855374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15020): Terminating (SIGTERM) 18:11:00.910495 --- ParallelTerminationStrategy: PID 15014 died... 18:11:00.931739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Terminated: ok {rc=0} 18:11:00.981702 --- ParallelTerminationStrategy: PID 15017 died... 18:11:01.002042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Terminated: ok {rc=0} 18:11:01.049658 --- ParallelTerminationStrategy: PID 15020 died... 18:11:01.070594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15020): Terminated: ok {rc=0} 18:11:01.165757 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:11:02.475231 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:02.482610 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:11:02.512451 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:11:02.548739 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:11:02.604714 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:11:02.635885 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:11:02.671884 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:11:03.231302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:11:03.236740 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.248880 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:11:03.317386 tst switch_tch_pdch.py: using LAC 35355 18:11:03.447602 tst switch_tch_pdch.py: using RAC 165 18:11:03.573570 tst switch_tch_pdch.py: using CellId 35355 18:11:03.698324 tst switch_tch_pdch.py: using BVCI 35356 18:11:03.817741 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.829663 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.841338 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.853182 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.865273 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.877259 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.889389 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:11:03.901434 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:04.021345 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:04.143612 tst switch_tch_pdch.py:51: start network... 18:11:04.362349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:04.862157 run create_hlr_db(pid=15025): Launched 18:11:04.986617 bus /gobi_6: Setting Powered False 18:11:06.050131 run create_hlr_db(pid=15025): Terminated: ok {rc=0} 18:11:06.502273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15027): Launched 18:11:06.826657 run osmo-hlr_10.42.42.2(pid=15028): Launched 18:11:06.951604 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:07.510635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15030): Launched 18:11:07.837688 run osmo-stp_10.42.42.5(pid=15031): Launched 18:11:07.963538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:11:08.526900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15033): Launched 18:11:08.652493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:11:08.927174 run patchelf(pid=15034): Launched 18:11:09.107870 run osmo-stp_10.42.42.5(pid=15031): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15031)] 18:11:09.245948 run osmo-stp_10.42.42.5(pid=15031): stdout: | (launched: 2022-12-13_18:11:07.777433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:09.385444 run osmo-stp_10.42.42.5(pid=15031): stderr: | [0;m[38;5;43m20221213181107970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181107971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181107971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181107971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:09.524880 run osmo-stp_10.42.42.5(pid=15031): stdout: | (launched: 2022-12-13_18:11:07.777433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:09.658221 run osmo-stp_10.42.42.5(pid=15031): stderr: | [0;m[38;5;43m20221213181107970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181107971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181107971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181107971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181107972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:09.815581 run patchelf(pid=15034): Terminating (SIGINT) 18:11:09.998603 run patchelf(pid=15034): Terminated: ok {rc=0} 18:11:10.130457 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15031): Process ended prematurely: osmo-stp_10.42.42.5(pid=15031) [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15031)] [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:11:10.140190 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 18:11:10.168519 run osmo-hlr_10.42.42.2(pid=15028): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15028)] 18:11:10.219989 run osmo-hlr_10.42.42.2(pid=15028): stdout: | (launched: 2022-12-13_18:11:06.766330) 18:11:10.273402 run osmo-hlr_10.42.42.2(pid=15028): stderr: | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181106966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181106979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181106987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181106987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181106987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:10.326565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15027): Terminating (SIGTERM) 18:11:10.368841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15030): Terminating (SIGTERM) 18:11:10.411565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15033): Terminating (SIGTERM) 18:11:10.454637 --- ParallelTerminationStrategy: PID 15027 died... 18:11:10.475123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15027): Terminated: ok {rc=0} 18:11:10.522371 --- ParallelTerminationStrategy: PID 15030 died... 18:11:10.542707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15030): Terminated: ok {rc=0} 18:11:10.589600 --- ParallelTerminationStrategy: PID 15033 died... 18:11:10.609722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15033): Terminated: ok {rc=0} 18:11:10.699248 bus /gobi_0: Setting Powered False 18:11:11.802837 bus /gobi_0: Setting Powered False 18:11:12.921131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:11:14.181901 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:14.188255 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:11:14.217190 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:11:14.251720 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:11:14.307089 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:11:14.337821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:11:14.373320 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:11:14.926355 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:11:14.931684 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:14.942929 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:11:15.009136 tst switch_tch_pdch.py: using LAC 35356 18:11:15.127533 tst switch_tch_pdch.py: using RAC 166 18:11:15.247278 tst switch_tch_pdch.py: using CellId 35356 18:11:15.375742 tst switch_tch_pdch.py: using BVCI 35357 18:11:15.495400 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.507090 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.518908 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.530392 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.542695 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.555006 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.567528 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:11:15.579792 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:11:15.698652 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:11:15.821570 tst switch_tch_pdch.py:51: start network... 18:11:16.064523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:16.547327 run create_hlr_db(pid=15039): Launched 18:11:16.703556 bus /gobi_6: Setting Powered False 18:11:17.768443 run create_hlr_db(pid=15039): Terminated: ok {rc=0} 18:11:18.192036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Launched 18:11:18.518460 run osmo-hlr_10.42.42.2(pid=15042): Launched 18:11:18.643098 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:19.175005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Launched 18:11:19.501445 run osmo-stp_10.42.42.5(pid=15045): Launched 18:11:19.625878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:11:20.159564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15047): Launched 18:11:20.274917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:11:20.531415 run patchelf(pid=15048): Launched 18:11:20.699382 run osmo-stp_10.42.42.5(pid=15045): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] 18:11:20.827376 run osmo-stp_10.42.42.5(pid=15045): stdout: | (launched: 2022-12-13_18:11:19.441102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:20.957248 run osmo-stp_10.42.42.5(pid=15045): stderr: | [0;m[38;5;43m20221213181119634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181119635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181119635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181119635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:21.087006 run osmo-stp_10.42.42.5(pid=15045): stdout: | (launched: 2022-12-13_18:11:19.441102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:21.210407 run osmo-stp_10.42.42.5(pid=15045): stderr: | [0;m[38;5;43m20221213181119634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181119635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181119635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181119635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181119636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:21.356701 run patchelf(pid=15048): Terminating (SIGINT) 18:11:21.528076 run patchelf(pid=15048): Terminated: ok {rc=0} 18:11:21.652832 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15045): Process ended prematurely: osmo-stp_10.42.42.5(pid=15045) [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:11:21.662025 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:11:21.688919 run osmo-hlr_10.42.42.2(pid=15042): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15042)] 18:11:21.737412 run osmo-hlr_10.42.42.2(pid=15042): stdout: | (launched: 2022-12-13_18:11:18.458603) 18:11:21.787722 run osmo-hlr_10.42.42.2(pid=15042): stderr: | [0;m[1;31m20221213181118655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181118656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181118656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181118656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181118656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181118656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181118668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181118677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181118677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181118677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:21.838222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Terminating (SIGTERM) 18:11:21.878359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Terminating (SIGTERM) 18:11:21.919179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15047): Terminating (SIGTERM) 18:11:21.959543 --- ParallelTerminationStrategy: PID 15041 died... 18:11:21.978828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Terminated: ok {rc=0} 18:11:22.023275 --- ParallelTerminationStrategy: PID 15044 died... 18:11:22.042049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Terminated: ok {rc=0} 18:11:22.086588 --- ParallelTerminationStrategy: PID 15047 died... 18:11:22.105595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15047): Terminated: ok {rc=0} 18:11:22.192307 bus /gobi_0: Setting Powered False 18:11:23.293049 bus /gobi_0: Setting Powered False 18:11:24.408387 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_sms:nanobts --------------------------------------------------------------------- 18:11:25.660811 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:25.666051 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 18:11:25.691107 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 18:11:25.698296 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 18:11:25.751681 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 18:11:25.775382 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 18:11:25.782179 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 18:11:26.321361 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 18:11:26.326511 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 18:11:26.337409 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 18:11:26.375149 tst mo_mt_sms.py: using LAC 35357 18:11:26.501114 tst mo_mt_sms.py: using RAC 167 18:11:26.626287 tst mo_mt_sms.py: using CellId 35357 18:11:26.750774 tst mo_mt_sms.py: using BVCI 35358 18:11:26.867762 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:11:26.985496 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:11:27.101222 tst mo_mt_sms.py:9: start nitb and bts... 18:11:27.304693 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:11:27.922916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15052): Launched 18:11:28.227434 run osmo-nitb_10.42.42.2(pid=15053): Launched 18:11:28.394574 run osmo-nitb_10.42.42.2(pid=15053): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15053)] 18:11:28.530429 run osmo-nitb_10.42.42.2(pid=15053): stdout: | (launched: 2022-12-13_18:11:28.170932) 18:11:28.667065 run osmo-nitb_10.42.42.2(pid=15053): stderr: | (launched: 2022-12-13_18:11:28.215833) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:28.803901 run osmo-nitb_10.42.42.2(pid=15053): stdout: | (launched: 2022-12-13_18:11:28.170932) 18:11:28.934777 run osmo-nitb_10.42.42.2(pid=15053): stderr: | (launched: 2022-12-13_18:11:28.215833) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15053): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15053) [trial-2392↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15053)] 18:11:29.341297 tst osmo-nitb_10.42.42.2(pid=15053): stdout: | (launched: 2022-12-13_18:11:28.170932) 18:11:29.463117 tst osmo-nitb_10.42.42.2(pid=15053): stderr: | (launched: 2022-12-13_18:11:28.215833) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:29.606667 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15053): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15053) [trial-2392↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15053)] [trial-2392↪nitb_sms:nanobts↪mo_mt_sms.py:11] 18:11:29.615218 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:11:29.621782 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15052): Terminating (SIGTERM) 18:11:29.830426 --- ParallelTerminationStrategy: PID 15052 died... 18:11:29.851972 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15052): Terminated: ok {rc=0} 18:11:29.939924 bus /sierra_3: Setting Powered False 18:11:31.038892 bus /sierra_3: Setting Powered False 18:11:32.159086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:nanobts+band-1900 --------------------------------------------------------------------- 18:11:33.351078 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:33.356300 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:33.380304 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:11:33.407421 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 18:11:33.460589 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:33.485645 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:11:33.513531 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 18:11:34.058140 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 18:11:34.063396 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.074272 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:34.110771 tst mo_mt_sms.py: using LAC 35358 18:11:34.228881 tst mo_mt_sms.py: using RAC 168 18:11:34.347589 tst mo_mt_sms.py: using CellId 35358 18:11:34.467507 tst mo_mt_sms.py: using BVCI 35359 18:11:34.578143 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.588805 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.599409 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.609938 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.620433 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:34.630954 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:11:34.747737 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:11:34.865340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:35.332245 run create_hlr_db(pid=15057): Launched 18:11:35.455218 bus /sierra_2: Setting Powered False 18:11:36.515996 run create_hlr_db(pid=15057): Terminated: ok {rc=0} 18:11:36.959399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Launched 18:11:37.285208 run osmo-hlr_10.42.42.2(pid=15060): Launched 18:11:37.409842 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:37.967817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Launched 18:11:38.293481 run osmo-stp_10.42.42.5(pid=15063): Launched 18:11:38.417474 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:39.005405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15065): Launched 18:11:39.333346 run osmo-msc_10.42.42.6(pid=15066): Launched 18:11:39.514874 run osmo-stp_10.42.42.5(pid=15063): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15063)] 18:11:39.651745 run osmo-stp_10.42.42.5(pid=15063): stdout: | (launched: 2022-12-13_18:11:38.233105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:39.789242 run osmo-stp_10.42.42.5(pid=15063): stderr: | [0;m[38;5;43m20221213181138427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181138427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181138428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181138428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:39.925313 run osmo-stp_10.42.42.5(pid=15063): stdout: | (launched: 2022-12-13_18:11:38.233105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:40.054341 run osmo-stp_10.42.42.5(pid=15063): stderr: | [0;m[38;5;43m20221213181138427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181138427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181138428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181138428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181138429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:40.208652 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15063): Process ended prematurely: osmo-stp_10.42.42.5(pid=15063) [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15063)] [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 18:11:40.217738 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 18:11:40.245363 run osmo-hlr_10.42.42.2(pid=15060): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15060)] 18:11:40.297412 run osmo-hlr_10.42.42.2(pid=15060): stdout: | (launched: 2022-12-13_18:11:37.224569) 18:11:40.351034 run osmo-hlr_10.42.42.2(pid=15060): stderr: | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181137424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181137437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181137445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181137445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181137446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:40.424550 run osmo-msc_10.42.42.6(pid=15066): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15066)] 18:11:40.475459 run osmo-msc_10.42.42.6(pid=15066): stdout: | (launched: 2022-12-13_18:11:39.272574) 18:11:40.527993 run osmo-msc_10.42.42.6(pid=15066): stderr: | [0;m[38;5;43m20221213181139593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181139593 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e1e3eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181139593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181139594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181139594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181139594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181139596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181139596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181139596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181139596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:40.581259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Terminating (SIGTERM) 18:11:40.623508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Terminating (SIGTERM) 18:11:40.666178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15065): Terminating (SIGTERM) 18:11:40.708888 --- ParallelTerminationStrategy: PID 15059 died... 18:11:40.729528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Terminated: ok {rc=0} 18:11:40.776431 --- ParallelTerminationStrategy: PID 15062 died... 18:11:40.796508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Terminated: ok {rc=0} 18:11:40.843228 --- ParallelTerminationStrategy: PID 15065 died... 18:11:40.863300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15065): Terminated: ok {rc=0} 18:11:40.952227 bus /sierra_3: Setting Powered False 18:11:42.054771 bus /sierra_3: Setting Powered False 18:11:43.175548 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:11:44.402566 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:44.407604 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:44.432100 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 18:11:44.439115 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:11:44.475581 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:44.500359 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 18:11:44.507361 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:11:45.028011 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:11:45.033581 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 18:11:45.045056 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:45.084770 tst assert_extension.py: using LAC 35359 18:11:45.211751 tst assert_extension.py: using RAC 169 18:11:45.340264 tst assert_extension.py: using CellId 35359 18:11:45.468901 tst assert_extension.py: using BVCI 35360 18:11:45.586408 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:11:45.703542 tst assert_extension.py:10: start nitb and bts... 18:11:45.909143 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:11:46.539018 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15071): Launched 18:11:46.950433 run osmo-nitb_10.42.42.2(pid=15072): Launched 18:11:47.135952 run osmo-nitb_10.42.42.2(pid=15072): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15072)] 18:11:47.271860 run osmo-nitb_10.42.42.2(pid=15072): stdout: | (launched: 2022-12-13_18:11:46.873910) 18:11:47.407181 run osmo-nitb_10.42.42.2(pid=15072): stderr: | (launched: 2022-12-13_18:11:46.933786) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:47.542423 run osmo-nitb_10.42.42.2(pid=15072): stdout: | (launched: 2022-12-13_18:11:46.873910) 18:11:47.672522 run osmo-nitb_10.42.42.2(pid=15072): stderr: | (launched: 2022-12-13_18:11:46.933786) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15072) [trial-2392↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15072)] 18:11:48.082273 tst osmo-nitb_10.42.42.2(pid=15072): stdout: | (launched: 2022-12-13_18:11:46.873910) 18:11:48.213069 tst osmo-nitb_10.42.42.2(pid=15072): stderr: | (launched: 2022-12-13_18:11:46.933786) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:48.365644 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15072) [trial-2392↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15072)] [trial-2392↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 18:11:48.374634 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:11:48.381684 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15071): Terminating (SIGTERM) 18:11:48.593154 --- ParallelTerminationStrategy: PID 15071 died... 18:11:48.614571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15071): Terminated: ok {rc=0} 18:11:48.704496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:11:49.873415 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:49.878651 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:49.902629 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:11:49.930768 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:11:49.966807 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:49.990574 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:11:50.017057 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:11:50.546125 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:11:50.551316 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:50.562228 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:50.599043 tst assert_extension.py: using LAC 35360 18:11:50.718264 tst assert_extension.py: using RAC 170 18:11:50.842989 tst assert_extension.py: using CellId 35360 18:11:50.965571 tst assert_extension.py: using BVCI 35361 18:11:51.076276 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:51.087095 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:51.097657 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:51.108302 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:51.119252 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:51.129684 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:11:51.247337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:51.739715 run create_hlr_db(pid=15076): Launched 18:11:51.860803 bus /sierra_2: Setting Powered False 18:11:52.923818 run create_hlr_db(pid=15076): Terminated: ok {rc=0} 18:11:53.350595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Launched 18:11:53.649086 run osmo-hlr_10.42.42.2(pid=15079): Launched 18:11:53.763753 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:54.278110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Launched 18:11:54.574875 run osmo-stp_10.42.42.5(pid=15082): Launched 18:11:54.687381 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:55.233027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15084): Launched 18:11:55.531090 run osmo-msc_10.42.42.6(pid=15085): Launched 18:11:55.696539 run osmo-stp_10.42.42.5(pid=15082): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] 18:11:55.822415 run osmo-stp_10.42.42.5(pid=15082): stdout: | (launched: 2022-12-13_18:11:54.519693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:55.956026 run osmo-stp_10.42.42.5(pid=15082): stderr: | [0;m[38;5;43m20221213181154685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181154686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181154686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181154686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:56.088865 run osmo-stp_10.42.42.5(pid=15082): stdout: | (launched: 2022-12-13_18:11:54.519693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:56.216241 run osmo-stp_10.42.42.5(pid=15082): stderr: | [0;m[38;5;43m20221213181154685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181154686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181154686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181154686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181154687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:56.368654 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15082): Process ended prematurely: osmo-stp_10.42.42.5(pid=15082) [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py:17] 18:11:56.377889 tst assert_extension.py:17: Test FAILED (5.8 sec) 18:11:56.405385 run osmo-hlr_10.42.42.2(pid=15079): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15079)] 18:11:56.457218 run osmo-hlr_10.42.42.2(pid=15079): stdout: | (launched: 2022-12-13_18:11:53.593625) 18:11:56.510271 run osmo-hlr_10.42.42.2(pid=15079): stderr: | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181153766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181153778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181153787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181153787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181153787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:56.584273 run osmo-msc_10.42.42.6(pid=15085): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15085)] 18:11:56.635172 run osmo-msc_10.42.42.6(pid=15085): stdout: | (launched: 2022-12-13_18:11:55.475788) 18:11:56.688337 run osmo-msc_10.42.42.6(pid=15085): stderr: | [0;m[38;5;43m20221213181155743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181155744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7febf94ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181155744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181155744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181155744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181155744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181155746 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181155746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181155747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181155747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:56.741900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Terminating (SIGTERM) 18:11:56.784320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Terminating (SIGTERM) 18:11:56.827505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15084): Terminating (SIGTERM) 18:11:56.878064 --- ParallelTerminationStrategy: PID 15078 died... 18:11:56.898167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Terminated: ok {rc=0} 18:11:56.945331 --- ParallelTerminationStrategy: PID 15081 died... 18:11:56.965483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Terminated: ok {rc=0} 18:11:57.012266 --- ParallelTerminationStrategy: PID 15084 died... 18:11:57.032490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15084): Terminated: ok {rc=0} 18:11:57.122074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:11:58.320736 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:58.327897 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:11:58.351152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:11:58.377394 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:11:58.434618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:11:58.458632 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:11:58.484609 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:11:59.031702 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:11:59.084210 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.096037 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:11:59.154721 tst mo_mt_call.py: using LAC 35361 18:11:59.280351 tst mo_mt_call.py: using RAC 171 18:11:59.408662 tst mo_mt_call.py: using CellId 35361 18:11:59.533741 tst mo_mt_call.py: using BVCI 35362 18:11:59.651879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.663385 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.674721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.686112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.697990 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:59.709714 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:59.827961 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:59.944095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:00.406133 run create_hlr_db(pid=15090): Launched 18:12:00.528391 bus /sierra_2: Setting Powered False 18:12:01.606921 run create_hlr_db(pid=15090): Terminated: ok {rc=0} 18:12:02.067196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Launched 18:12:02.378150 run osmo-hlr_10.42.42.2(pid=15093): Launched 18:12:02.493790 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:03.018152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Launched 18:12:03.343150 run osmo-stp_10.42.42.5(pid=15096): Launched 18:12:03.456233 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:04.003417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Launched 18:12:04.307865 run osmo-msc_10.42.42.6(pid=15099): Launched 18:12:04.477273 run osmo-stp_10.42.42.5(pid=15096): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] 18:12:04.605499 run osmo-stp_10.42.42.5(pid=15096): stdout: | (launched: 2022-12-13_18:12:03.287343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:04.733770 run osmo-stp_10.42.42.5(pid=15096): stderr: | [0;m[38;5;43m20221213181203454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181203454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181203455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181203455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181203455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181203455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181203456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:04.859540 run osmo-stp_10.42.42.5(pid=15096): stdout: | (launched: 2022-12-13_18:12:03.287343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:04.979421 run osmo-stp_10.42.42.5(pid=15096): stderr: | [0;m[38;5;43m20221213181203454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181203454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181203455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181203455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181203455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181203455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181203456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:05.123490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15096): Process ended prematurely: osmo-stp_10.42.42.5(pid=15096) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:12:05.132304 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:12:05.158385 run osmo-hlr_10.42.42.2(pid=15093): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15093)] 18:12:05.205832 run osmo-hlr_10.42.42.2(pid=15093): stdout: | (launched: 2022-12-13_18:12:02.321993) 18:12:05.254876 run osmo-hlr_10.42.42.2(pid=15093): stderr: | [0;m[1;31m20221213181202493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181202493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181202493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181202493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181202494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181202494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181202506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181202515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181202515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181202515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:05.323760 run osmo-msc_10.42.42.6(pid=15099): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15099)] 18:12:05.371376 run osmo-msc_10.42.42.6(pid=15099): stdout: | (launched: 2022-12-13_18:12:04.251152) 18:12:05.420643 run osmo-msc_10.42.42.6(pid=15099): stderr: | [0;m[38;5;43m20221213181204522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181204522 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa92831c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181204522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181204522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181204523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181204523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181204525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181204525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181204525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181204525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:05.470288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Terminating (SIGTERM) 18:12:05.509658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Terminating (SIGTERM) 18:12:05.549831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Terminating (SIGTERM) 18:12:05.590162 --- ParallelTerminationStrategy: PID 15092 died... 18:12:05.609356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Terminated: ok {rc=0} 18:12:05.653321 --- ParallelTerminationStrategy: PID 15095 died... 18:12:05.671714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Terminated: ok {rc=0} 18:12:05.715622 --- ParallelTerminationStrategy: PID 15098 died... 18:12:05.734228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Terminated: ok {rc=0} 18:12:05.817864 bus /sierra_3: Setting Powered False 18:12:06.917077 bus /sierra_3: Setting Powered False 18:12:08.035792 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:12:09.182916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.194810 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:12:09.253996 tst mo_mt_call_osmux.py: using LAC 35362 18:12:09.373019 tst mo_mt_call_osmux.py: using RAC 172 18:12:09.492527 tst mo_mt_call_osmux.py: using CellId 35362 18:12:09.614874 tst mo_mt_call_osmux.py: using BVCI 35363 18:12:09.725114 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.736159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.747107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.758152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.769217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:12:09.780086 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:12:09.900531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:12:10.019457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:10.519853 run create_hlr_db(pid=15101): Launched 18:12:10.644487 bus /sierra_2: Setting Powered False 18:12:11.708807 run create_hlr_db(pid=15101): Terminated: ok {rc=0} 18:12:12.143765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15103): Launched 18:12:12.449265 run osmo-hlr_10.42.42.2(pid=15104): Launched 18:12:12.564401 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:13.093295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15106): Launched 18:12:13.397579 run osmo-stp_10.42.42.5(pid=15107): Launched 18:12:13.513494 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:14.065569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15109): Launched 18:12:14.371621 run osmo-msc_10.42.42.6(pid=15110): Launched 18:12:14.540731 run osmo-stp_10.42.42.5(pid=15107): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15107)] 18:12:14.668417 run osmo-stp_10.42.42.5(pid=15107): stdout: | (launched: 2022-12-13_18:12:13.341307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:14.795993 run osmo-stp_10.42.42.5(pid=15107): stderr: | [0;m[38;5;43m20221213181213508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181213509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181213509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181213509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:14.922099 run osmo-stp_10.42.42.5(pid=15107): stdout: | (launched: 2022-12-13_18:12:13.341307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:15.042355 run osmo-stp_10.42.42.5(pid=15107): stderr: | [0;m[38;5;43m20221213181213508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181213509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181213509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181213509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181213510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:15.186914 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15107): Process ended prematurely: osmo-stp_10.42.42.5(pid=15107) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15107)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:12:15.195712 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:12:15.222161 run osmo-hlr_10.42.42.2(pid=15104): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15104)] 18:12:15.270060 run osmo-hlr_10.42.42.2(pid=15104): stdout: | (launched: 2022-12-13_18:12:12.393087) 18:12:15.319923 run osmo-hlr_10.42.42.2(pid=15104): stderr: | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181212567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181212580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181212589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181212589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181212589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:15.389319 run osmo-msc_10.42.42.6(pid=15110): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15110)] 18:12:15.437318 run osmo-msc_10.42.42.6(pid=15110): stdout: | (launched: 2022-12-13_18:12:14.315067) 18:12:15.486819 run osmo-msc_10.42.42.6(pid=15110): stderr: | [0;m[38;5;43m20221213181214585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181214585 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3515263c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181214585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181214585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181214585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181214586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181214587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181214588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:15.536692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15103): Terminating (SIGTERM) 18:12:15.576106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15106): Terminating (SIGTERM) 18:12:15.615519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15109): Terminating (SIGTERM) 18:12:15.655216 --- ParallelTerminationStrategy: PID 15103 died... 18:12:15.674408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15103): Terminated: ok {rc=0} 18:12:15.718467 --- ParallelTerminationStrategy: PID 15106 died... 18:12:15.737161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15106): Terminated: ok {rc=0} 18:12:15.781073 --- ParallelTerminationStrategy: PID 15109 died... 18:12:15.799710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15109): Terminated: ok {rc=0} 18:12:15.883977 bus /sierra_3: Setting Powered False 18:12:16.989092 bus /sierra_3: Setting Powered False 18:12:18.104162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:12:19.342825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:19.350212 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:12:19.373603 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:12:19.399606 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:12:19.449550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:12:19.473456 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:12:19.499867 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:12:20.050711 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:12:20.101075 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.112363 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:12:20.172588 tst mo_mt_call.py: using LAC 35363 18:12:20.292496 tst mo_mt_call.py: using RAC 173 18:12:20.411950 tst mo_mt_call.py: using CellId 35363 18:12:20.530469 tst mo_mt_call.py: using BVCI 35364 18:12:20.640928 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.652483 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.663561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.674676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.685800 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:20.696768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:20.816527 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:20.935322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:21.401913 run create_hlr_db(pid=15115): Launched 18:12:21.526809 bus /sierra_2: Setting Powered False 18:12:22.586701 run create_hlr_db(pid=15115): Terminated: ok {rc=0} 18:12:23.031911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15117): Launched 18:12:23.360178 run osmo-hlr_10.42.42.2(pid=15118): Launched 18:12:23.484842 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:24.051843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15120): Launched 18:12:24.381423 run osmo-stp_10.42.42.5(pid=15121): Launched 18:12:24.506766 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:25.100603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15123): Launched 18:12:25.429256 run osmo-msc_10.42.42.6(pid=15124): Launched 18:12:25.611370 run osmo-stp_10.42.42.5(pid=15121): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15121)] 18:12:25.748263 run osmo-stp_10.42.42.5(pid=15121): stdout: | (launched: 2022-12-13_18:12:24.320606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:25.886212 run osmo-stp_10.42.42.5(pid=15121): stderr: | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181224510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:26.022858 run osmo-stp_10.42.42.5(pid=15121): stdout: | (launched: 2022-12-13_18:12:24.320606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:26.153298 run osmo-stp_10.42.42.5(pid=15121): stderr: | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181224510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181224510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181224511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:26.309224 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15121): Process ended prematurely: osmo-stp_10.42.42.5(pid=15121) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15121)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:12:26.318923 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:12:26.347051 run osmo-hlr_10.42.42.2(pid=15118): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15118)] 18:12:26.398484 run osmo-hlr_10.42.42.2(pid=15118): stdout: | (launched: 2022-12-13_18:12:23.300001) 18:12:26.451118 run osmo-hlr_10.42.42.2(pid=15118): stderr: | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181223493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181223503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181223514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181223514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181223514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:26.524380 run osmo-msc_10.42.42.6(pid=15124): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15124)] 18:12:26.575088 run osmo-msc_10.42.42.6(pid=15124): stdout: | (launched: 2022-12-13_18:12:25.369413) 18:12:26.627364 run osmo-msc_10.42.42.6(pid=15124): stderr: | [0;m[38;5;43m20221213181225686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181225687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f929a82dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181225687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181225687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181225687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181225687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181225689 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181225689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181225690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181225690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:26.680113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15117): Terminating (SIGTERM) 18:12:26.722318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15120): Terminating (SIGTERM) 18:12:26.764704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15123): Terminating (SIGTERM) 18:12:26.807362 --- ParallelTerminationStrategy: PID 15117 died... 18:12:26.827872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15117): Terminated: ok {rc=0} 18:12:26.875165 --- ParallelTerminationStrategy: PID 15120 died... 18:12:26.895252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15120): Terminated: ok {rc=0} 18:12:26.941975 --- ParallelTerminationStrategy: PID 15123 died... 18:12:26.962001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15123): Terminated: ok {rc=0} 18:12:27.051758 bus /sierra_3: Setting Powered False 18:12:28.150900 bus /sierra_3: Setting Powered False 18:12:29.268430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:12:30.418805 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:30.431272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:12:30.492702 tst mo_mt_call_osmux.py: using LAC 35364 18:12:30.622284 tst mo_mt_call_osmux.py: using RAC 174 18:12:30.756854 tst mo_mt_call_osmux.py: using CellId 35364 18:12:30.906839 tst mo_mt_call_osmux.py: using BVCI 35365 18:12:31.044393 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:31.056732 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:31.068907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:31.081258 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:31.093551 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:31.105392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:31.228309 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:31.354791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:31.877335 run create_hlr_db(pid=15126): Launched 18:12:32.038610 bus /sierra_2: Setting Powered False 18:12:33.103510 run create_hlr_db(pid=15126): Terminated: ok {rc=0} 18:12:33.558550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15128): Launched 18:12:33.887732 run osmo-hlr_10.42.42.2(pid=15129): Launched 18:12:34.014257 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:34.581428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15131): Launched 18:12:34.910850 run osmo-stp_10.42.42.5(pid=15132): Launched 18:12:35.037200 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:35.632288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15134): Launched 18:12:35.962389 run osmo-msc_10.42.42.6(pid=15135): Launched 18:12:36.147821 run osmo-stp_10.42.42.5(pid=15132): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15132)] 18:12:36.286058 run osmo-stp_10.42.42.5(pid=15132): stdout: | (launched: 2022-12-13_18:12:34.850742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:36.425566 run osmo-stp_10.42.42.5(pid=15132): stderr: | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181235039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:36.563321 run osmo-stp_10.42.42.5(pid=15132): stdout: | (launched: 2022-12-13_18:12:34.850742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:36.693907 run osmo-stp_10.42.42.5(pid=15132): stderr: | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181235038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181235039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181235039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:36.850680 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15132): Process ended prematurely: osmo-stp_10.42.42.5(pid=15132) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15132)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:12:36.860347 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:12:36.888466 run osmo-hlr_10.42.42.2(pid=15129): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15129)] 18:12:36.939986 run osmo-hlr_10.42.42.2(pid=15129): stdout: | (launched: 2022-12-13_18:12:33.827880) 18:12:36.992822 run osmo-hlr_10.42.42.2(pid=15129): stderr: | [0;m[1;31m20221213181234022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181234023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181234023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181234023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181234023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181234023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181234040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181234051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181234051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181234051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:37.066167 run osmo-msc_10.42.42.6(pid=15135): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15135)] 18:12:37.117231 run osmo-msc_10.42.42.6(pid=15135): stdout: | (launched: 2022-12-13_18:12:35.901977) 18:12:37.169489 run osmo-msc_10.42.42.6(pid=15135): stderr: | [0;m[38;5;43m20221213181236222 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181236222 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf88605c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181236222 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181236222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181236222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181236222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181236224 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181236225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181236225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181236225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:37.222119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15128): Terminating (SIGTERM) 18:12:37.264386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15131): Terminating (SIGTERM) 18:12:37.307341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15134): Terminating (SIGTERM) 18:12:37.350327 --- ParallelTerminationStrategy: PID 15128 died... 18:12:37.370809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15128): Terminated: ok {rc=0} 18:12:37.418272 --- ParallelTerminationStrategy: PID 15131 died... 18:12:37.438261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15131): Terminated: ok {rc=0} 18:12:37.485114 --- ParallelTerminationStrategy: PID 15134 died... 18:12:37.505230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15134): Terminated: ok {rc=0} 18:12:37.594121 bus /sierra_3: Setting Powered False 18:12:38.693950 bus /sierra_3: Setting Powered False 18:12:39.811713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:12:41.055008 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:41.063253 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:12:41.087686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:12:41.115763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:12:41.168599 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:12:41.193424 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:12:41.221142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:12:41.774655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:12:41.827704 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:41.839424 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:12:41.900543 tst mo_mt_call.py: using LAC 35365 18:12:42.038248 tst mo_mt_call.py: using RAC 175 18:12:42.176846 tst mo_mt_call.py: using CellId 35365 18:12:42.312526 tst mo_mt_call.py: using BVCI 35366 18:12:42.433568 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:42.445262 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:42.456678 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:42.468247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:42.480154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:42.491940 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:42.610179 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:42.732138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:43.237050 run create_hlr_db(pid=15140): Launched 18:12:43.363238 bus /sierra_2: Setting Powered False 18:12:44.428299 run create_hlr_db(pid=15140): Terminated: ok {rc=0} 18:12:44.866523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15142): Launched 18:12:45.173095 run osmo-hlr_10.42.42.2(pid=15143): Launched 18:12:45.290092 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:45.822404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15145): Launched 18:12:46.189973 run osmo-stp_10.42.42.5(pid=15146): Launched 18:12:46.463888 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:47.152538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15148): Launched 18:12:47.494753 run osmo-msc_10.42.42.6(pid=15149): Launched 18:12:47.681258 run osmo-stp_10.42.42.5(pid=15146): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15146)] 18:12:47.820395 run osmo-stp_10.42.42.5(pid=15146): stdout: | (launched: 2022-12-13_18:12:46.126987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:47.960399 run osmo-stp_10.42.42.5(pid=15146): stderr: | [0;m[38;5;43m20221213181246409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181246410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181246410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181246410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:48.097991 run osmo-stp_10.42.42.5(pid=15146): stdout: | (launched: 2022-12-13_18:12:46.126987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:48.229141 run osmo-stp_10.42.42.5(pid=15146): stderr: | [0;m[38;5;43m20221213181246409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181246410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181246410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181246410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181246411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:48.386064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15146): Process ended prematurely: osmo-stp_10.42.42.5(pid=15146) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15146)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:12:48.395605 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:12:48.423740 run osmo-hlr_10.42.42.2(pid=15143): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15143)] 18:12:48.475203 run osmo-hlr_10.42.42.2(pid=15143): stdout: | (launched: 2022-12-13_18:12:45.116556) 18:12:48.527791 run osmo-hlr_10.42.42.2(pid=15143): stderr: | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181245290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181245303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181245313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181245314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181245314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:48.601160 run osmo-msc_10.42.42.6(pid=15149): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15149)] 18:12:48.651891 run osmo-msc_10.42.42.6(pid=15149): stdout: | (launched: 2022-12-13_18:12:47.434642) 18:12:48.704340 run osmo-msc_10.42.42.6(pid=15149): stderr: | [0;m[38;5;43m20221213181247751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181247751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cea23dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181247752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181247752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181247752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181247752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181247754 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181247754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181247754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181247754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:48.757408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15142): Terminating (SIGTERM) 18:12:48.799377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15145): Terminating (SIGTERM) 18:12:48.841955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15148): Terminating (SIGTERM) 18:12:48.884568 --- ParallelTerminationStrategy: PID 15142 died... 18:12:48.905243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15142): Terminated: ok {rc=0} 18:12:48.951985 --- ParallelTerminationStrategy: PID 15145 died... 18:12:48.971890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15145): Terminated: ok {rc=0} 18:12:49.018712 --- ParallelTerminationStrategy: PID 15148 died... 18:12:49.039003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15148): Terminated: ok {rc=0} 18:12:49.128260 bus /sierra_3: Setting Powered False 18:12:50.227957 bus /sierra_3: Setting Powered False 18:12:51.349194 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:12:52.501636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:52.514351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:12:52.576936 tst mo_mt_call_osmux.py: using LAC 35366 18:12:52.706431 tst mo_mt_call_osmux.py: using RAC 176 18:12:52.835925 tst mo_mt_call_osmux.py: using CellId 35366 18:12:52.965309 tst mo_mt_call_osmux.py: using BVCI 35367 18:12:53.083571 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:53.095389 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:53.107069 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:53.118658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:53.130678 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:53.142629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:53.266441 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:53.386265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:53.862241 run create_hlr_db(pid=15151): Launched 18:12:53.990027 bus /sierra_2: Setting Powered False 18:12:55.051354 run create_hlr_db(pid=15151): Terminated: ok {rc=0} 18:12:55.479649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15153): Launched 18:12:55.788258 run osmo-hlr_10.42.42.2(pid=15154): Launched 18:12:55.904588 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:56.450616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15156): Launched 18:12:56.758138 run osmo-stp_10.42.42.5(pid=15157): Launched 18:12:56.874814 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:57.435024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15159): Launched 18:12:57.744189 run osmo-msc_10.42.42.6(pid=15160): Launched 18:12:57.916517 run osmo-stp_10.42.42.5(pid=15157): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15157)] 18:12:58.046383 run osmo-stp_10.42.42.5(pid=15157): stdout: | (launched: 2022-12-13_18:12:56.701343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:58.176050 run osmo-stp_10.42.42.5(pid=15157): stderr: | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181256870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:58.304218 run osmo-stp_10.42.42.5(pid=15157): stdout: | (launched: 2022-12-13_18:12:56.701343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:58.426860 run osmo-stp_10.42.42.5(pid=15157): stderr: | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181256869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181256870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181256870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:58.573148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15157): Process ended prematurely: osmo-stp_10.42.42.5(pid=15157) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15157)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:12:58.582160 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:12:58.608721 run osmo-hlr_10.42.42.2(pid=15154): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15154)] 18:12:58.656821 run osmo-hlr_10.42.42.2(pid=15154): stdout: | (launched: 2022-12-13_18:12:55.730865) 18:12:58.706716 run osmo-hlr_10.42.42.2(pid=15154): stderr: | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181255919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181255929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181255929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181255929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:58.776405 run osmo-msc_10.42.42.6(pid=15160): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15160)] 18:12:58.824245 run osmo-msc_10.42.42.6(pid=15160): stdout: | (launched: 2022-12-13_18:12:57.687361) 18:12:58.873788 run osmo-msc_10.42.42.6(pid=15160): stderr: | [0;m[38;5;43m20221213181257957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181257957 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54b9a7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181257957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181257957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181257957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181257958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181257959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181257960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181257960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181257960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:58.923649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15153): Terminating (SIGTERM) 18:12:58.963950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15156): Terminating (SIGTERM) 18:12:59.004844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15159): Terminating (SIGTERM) 18:12:59.045464 --- ParallelTerminationStrategy: PID 15153 died... 18:12:59.065236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15153): Terminated: ok {rc=0} 18:12:59.109753 --- ParallelTerminationStrategy: PID 15156 died... 18:12:59.128529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15156): Terminated: ok {rc=0} 18:12:59.173275 --- ParallelTerminationStrategy: PID 15159 died... 18:12:59.192066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15159): Terminated: ok {rc=0} 18:12:59.279331 bus /sierra_3: Setting Powered False 18:13:00.379923 bus /sierra_3: Setting Powered False 18:13:01.497123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:13:02.747536 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:02.755856 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:13:02.780368 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:13:02.808898 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:13:02.863275 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:13:02.888076 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:13:02.915646 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:13:03.466865 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:13:03.519903 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:03.531728 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:13:03.593660 tst mo_mt_call.py: using LAC 35367 18:13:03.722936 tst mo_mt_call.py: using RAC 177 18:13:03.843808 tst mo_mt_call.py: using CellId 35367 18:13:03.965419 tst mo_mt_call.py: using BVCI 35368 18:13:04.076459 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:04.087696 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:04.098819 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:04.109952 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:04.121041 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:04.132041 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:13:04.253546 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:13:04.376205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:04.881725 run create_hlr_db(pid=15165): Launched 18:13:05.009197 bus /sierra_2: Setting Powered False 18:13:06.074193 run create_hlr_db(pid=15165): Terminated: ok {rc=0} 18:13:06.514864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15167): Launched 18:13:06.822991 run osmo-hlr_10.42.42.2(pid=15168): Launched 18:13:06.939698 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:07.479942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15170): Launched 18:13:07.787962 run osmo-stp_10.42.42.5(pid=15171): Launched 18:13:07.905400 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:08.460759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15173): Launched 18:13:08.768706 run osmo-msc_10.42.42.6(pid=15174): Launched 18:13:08.940003 run osmo-stp_10.42.42.5(pid=15171): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15171)] 18:13:09.069265 run osmo-stp_10.42.42.5(pid=15171): stdout: | (launched: 2022-12-13_18:13:07.731288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:09.198380 run osmo-stp_10.42.42.5(pid=15171): stderr: | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181307900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:09.326171 run osmo-stp_10.42.42.5(pid=15171): stdout: | (launched: 2022-12-13_18:13:07.731288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:09.447632 run osmo-stp_10.42.42.5(pid=15171): stderr: | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181307899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181307900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181307900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:09.593203 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15171): Process ended prematurely: osmo-stp_10.42.42.5(pid=15171) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15171)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:13:09.602044 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:13:09.628729 run osmo-hlr_10.42.42.2(pid=15168): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15168)] 18:13:09.676749 run osmo-hlr_10.42.42.2(pid=15168): stdout: | (launched: 2022-12-13_18:13:06.766522) 18:13:09.726457 run osmo-hlr_10.42.42.2(pid=15168): stderr: | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181306941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181306953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181306961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181306962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181306962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:09.796122 run osmo-msc_10.42.42.6(pid=15174): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15174)] 18:13:09.844119 run osmo-msc_10.42.42.6(pid=15174): stdout: | (launched: 2022-12-13_18:13:08.711648) 18:13:09.893686 run osmo-msc_10.42.42.6(pid=15174): stderr: | [0;m[38;5;43m20221213181308981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181308981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee51cddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181308981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181308981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181308981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181308982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181308983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181308984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181308984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181308984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:09.943859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15167): Terminating (SIGTERM) 18:13:09.983999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15170): Terminating (SIGTERM) 18:13:10.024027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15173): Terminating (SIGTERM) 18:13:10.064449 --- ParallelTerminationStrategy: PID 15167 died... 18:13:10.083810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15167): Terminated: ok {rc=0} 18:13:10.127998 --- ParallelTerminationStrategy: PID 15170 died... 18:13:10.146694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15170): Terminated: ok {rc=0} 18:13:10.190805 --- ParallelTerminationStrategy: PID 15173 died... 18:13:10.209678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15173): Terminated: ok {rc=0} 18:13:10.295343 bus /sierra_3: Setting Powered False 18:13:11.396644 bus /sierra_3: Setting Powered False 18:13:12.513057 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:13:13.661974 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:13.673869 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:13:13.733912 tst mo_mt_call_osmux.py: using LAC 35368 18:13:13.855799 tst mo_mt_call_osmux.py: using RAC 178 18:13:13.976025 tst mo_mt_call_osmux.py: using CellId 35368 18:13:14.097615 tst mo_mt_call_osmux.py: using BVCI 35369 18:13:14.210654 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:14.221982 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:14.233025 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:14.243985 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:14.255047 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:13:14.266072 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:13:14.389431 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:13:14.513394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:15.020660 run create_hlr_db(pid=15176): Launched 18:13:15.146955 bus /sierra_2: Setting Powered False 18:13:16.211281 run create_hlr_db(pid=15176): Terminated: ok {rc=0} 18:13:16.673805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15178): Launched 18:13:17.017881 run osmo-hlr_10.42.42.2(pid=15179): Launched 18:13:17.206483 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:17.776873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15181): Launched 18:13:18.105763 run osmo-stp_10.42.42.5(pid=15182): Launched 18:13:18.233549 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:18.830313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15184): Launched 18:13:19.161768 run osmo-msc_10.42.42.6(pid=15185): Launched 18:13:19.348784 run osmo-stp_10.42.42.5(pid=15182): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15182)] 18:13:19.488071 run osmo-stp_10.42.42.5(pid=15182): stdout: | (launched: 2022-12-13_18:13:18.045525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:19.628424 run osmo-stp_10.42.42.5(pid=15182): stderr: | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181318235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:19.765859 run osmo-stp_10.42.42.5(pid=15182): stdout: | (launched: 2022-12-13_18:13:18.045525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:19.896827 run osmo-stp_10.42.42.5(pid=15182): stderr: | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181318235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181318235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181318236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:20.053620 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15182): Process ended prematurely: osmo-stp_10.42.42.5(pid=15182) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15182)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:13:20.063322 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:13:20.091376 run osmo-hlr_10.42.42.2(pid=15179): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15179)] 18:13:20.143069 run osmo-hlr_10.42.42.2(pid=15179): stdout: | (launched: 2022-12-13_18:13:16.956515) 18:13:20.195669 run osmo-hlr_10.42.42.2(pid=15179): stderr: | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181317211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181317223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181317232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181317232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181317233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:20.269545 run osmo-msc_10.42.42.6(pid=15185): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15185)] 18:13:20.320687 run osmo-msc_10.42.42.6(pid=15185): stdout: | (launched: 2022-12-13_18:13:19.101603) 18:13:20.373607 run osmo-msc_10.42.42.6(pid=15185): stderr: | [0;m[38;5;43m20221213181319419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181319419 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0be99a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181319419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181319419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181319420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181319420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181319422 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181319422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181319422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181319422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:20.426486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15178): Terminating (SIGTERM) 18:13:20.468799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15181): Terminating (SIGTERM) 18:13:20.511459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15184): Terminating (SIGTERM) 18:13:20.554433 --- ParallelTerminationStrategy: PID 15178 died... 18:13:20.575124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15178): Terminated: ok {rc=0} 18:13:20.622466 --- ParallelTerminationStrategy: PID 15181 died... 18:13:20.642800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15181): Terminated: ok {rc=0} 18:13:20.689690 --- ParallelTerminationStrategy: PID 15184 died... 18:13:20.709928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15184): Terminated: ok {rc=0} 18:13:20.799469 bus /sierra_3: Setting Powered False 18:13:21.897821 bus /sierra_3: Setting Powered False 18:13:23.018576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:13:24.259739 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:24.267169 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:13:24.290792 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:13:24.317439 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:13:24.369809 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:13:24.393732 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:13:24.420154 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:13:24.973200 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:13:25.022858 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.034377 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:13:25.094802 tst mo_mt_call.py: using LAC 35369 18:13:25.214681 tst mo_mt_call.py: using RAC 179 18:13:25.336699 tst mo_mt_call.py: using CellId 35369 18:13:25.461845 tst mo_mt_call.py: using BVCI 35370 18:13:25.573895 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.585230 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.596172 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.607132 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.618480 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:25.629735 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:25.751639 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:25.871030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:26.345213 run create_hlr_db(pid=15190): Launched 18:13:26.469613 bus /sierra_2: Setting Powered False 18:13:27.534854 run create_hlr_db(pid=15190): Terminated: ok {rc=0} 18:13:27.973777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15192): Launched 18:13:28.280132 run osmo-hlr_10.42.42.2(pid=15193): Launched 18:13:28.397146 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:28.925246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15195): Launched 18:13:29.233256 run osmo-stp_10.42.42.5(pid=15196): Launched 18:13:29.350232 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:29.908805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15198): Launched 18:13:30.217157 run osmo-msc_10.42.42.6(pid=15199): Launched 18:13:30.389352 run osmo-stp_10.42.42.5(pid=15196): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15196)] 18:13:30.518279 run osmo-stp_10.42.42.5(pid=15196): stdout: | (launched: 2022-12-13_18:13:29.176147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:30.648482 run osmo-stp_10.42.42.5(pid=15196): stderr: | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181329346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:30.776892 run osmo-stp_10.42.42.5(pid=15196): stdout: | (launched: 2022-12-13_18:13:29.176147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:30.924122 run osmo-stp_10.42.42.5(pid=15196): stderr: | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181329346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181329346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181329347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:31.079493 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15196): Process ended prematurely: osmo-stp_10.42.42.5(pid=15196) [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15196)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:13:31.090644 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:13:31.122249 run osmo-hlr_10.42.42.2(pid=15193): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15193)] 18:13:31.177254 run osmo-hlr_10.42.42.2(pid=15193): stdout: | (launched: 2022-12-13_18:13:28.223799) 18:13:31.232441 run osmo-hlr_10.42.42.2(pid=15193): stderr: | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181328400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181328412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181328421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181328421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181328421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:31.310542 run osmo-msc_10.42.42.6(pid=15199): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15199)] 18:13:31.364831 run osmo-msc_10.42.42.6(pid=15199): stdout: | (launched: 2022-12-13_18:13:30.160406) 18:13:31.420601 run osmo-msc_10.42.42.6(pid=15199): stderr: | [0;m[38;5;43m20221213181330430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181330430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd48ac1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181330430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181330430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181330430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181330431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181330432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181330433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181330433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181330433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:31.476246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15192): Terminating (SIGTERM) 18:13:31.521524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15195): Terminating (SIGTERM) 18:13:31.569674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15198): Terminating (SIGTERM) 18:13:31.616847 --- ParallelTerminationStrategy: PID 15192 died... 18:13:31.638083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15192): Terminated: ok {rc=0} 18:13:31.690976 --- ParallelTerminationStrategy: PID 15195 died... 18:13:31.713010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15195): Terminated: ok {rc=0} 18:13:31.764095 --- ParallelTerminationStrategy: PID 15198 died... 18:13:31.785049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15198): Terminated: ok {rc=0} 18:13:31.880398 bus /sierra_3: Setting Powered False 18:13:32.984475 bus /sierra_3: Setting Powered False 18:13:34.099202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:13:35.251949 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.264522 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:13:35.327664 tst mo_mt_call_osmux.py: using LAC 35370 18:13:35.455661 tst mo_mt_call_osmux.py: using RAC 180 18:13:35.585473 tst mo_mt_call_osmux.py: using CellId 35370 18:13:35.707161 tst mo_mt_call_osmux.py: using BVCI 35371 18:13:35.819519 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.830979 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.842507 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.853774 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.865799 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:35.877606 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:36.001922 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:36.123923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:36.631532 run create_hlr_db(pid=15201): Launched 18:13:36.759654 bus /sierra_2: Setting Powered False 18:13:37.824374 run create_hlr_db(pid=15201): Terminated: ok {rc=0} 18:13:38.281977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15203): Launched 18:13:38.611182 run osmo-hlr_10.42.42.2(pid=15204): Launched 18:13:38.738138 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:39.303398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15206): Launched 18:13:39.635062 run osmo-stp_10.42.42.5(pid=15207): Launched 18:13:39.760726 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:40.356566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15209): Launched 18:13:40.686026 run osmo-msc_10.42.42.6(pid=15210): Launched 18:13:40.870922 run osmo-stp_10.42.42.5(pid=15207): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15207)] 18:13:41.009624 run osmo-stp_10.42.42.5(pid=15207): stdout: | (launched: 2022-12-13_18:13:39.574250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:41.148520 run osmo-stp_10.42.42.5(pid=15207): stderr: | [0;m[38;5;43m20221213181339764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181339764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181339765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181339765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181339765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181339766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181339766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:41.285917 run osmo-stp_10.42.42.5(pid=15207): stdout: | (launched: 2022-12-13_18:13:39.574250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:41.417362 run osmo-stp_10.42.42.5(pid=15207): stderr: | [0;m[38;5;43m20221213181339764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181339764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181339765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181339765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181339765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181339766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181339766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:41.574397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15207): Process ended prematurely: osmo-stp_10.42.42.5(pid=15207) [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15207)] [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:13:41.584259 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:13:41.612866 run osmo-hlr_10.42.42.2(pid=15204): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15204)] 18:13:41.665560 run osmo-hlr_10.42.42.2(pid=15204): stdout: | (launched: 2022-12-13_18:13:38.551316) 18:13:41.718670 run osmo-hlr_10.42.42.2(pid=15204): stderr: | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181338747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181338759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181338767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181338767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181338768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:41.792789 run osmo-msc_10.42.42.6(pid=15210): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15210)] 18:13:41.843744 run osmo-msc_10.42.42.6(pid=15210): stdout: | (launched: 2022-12-13_18:13:40.625862) 18:13:41.896567 run osmo-msc_10.42.42.6(pid=15210): stderr: | [0;m[38;5;43m20221213181340946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181340947 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ed5e7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181340947 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181340947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181340947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181340947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181340949 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181340949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181340949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181340949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:41.949645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15203): Terminating (SIGTERM) 18:13:41.992058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15206): Terminating (SIGTERM) 18:13:42.034966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15209): Terminating (SIGTERM) 18:13:42.078028 --- ParallelTerminationStrategy: PID 15203 died... 18:13:42.099114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15203): Terminated: ok {rc=0} 18:13:42.146357 --- ParallelTerminationStrategy: PID 15206 died... 18:13:42.167096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15206): Terminated: ok {rc=0} 18:13:42.214256 --- ParallelTerminationStrategy: PID 15209 died... 18:13:42.234708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15209): Terminated: ok {rc=0} 18:13:42.324111 bus /sierra_3: Setting Powered False 18:13:43.422719 bus /sierra_3: Setting Powered False 18:13:44.541977 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:nanobts+band-1900 --------------------------------------------------------------------- 18:13:45.786934 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:45.792550 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:13:45.817147 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:13:45.848904 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:13:45.945741 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:13:45.972389 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:13:46.002268 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:13:46.613509 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 18:13:46.622622 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:46.635126 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:46.679286 tst emergency_mo_mt_call.py: using LAC 35371 18:13:46.810813 tst emergency_mo_mt_call.py: using RAC 181 18:13:46.939211 tst emergency_mo_mt_call.py: using CellId 35371 18:13:47.071743 tst emergency_mo_mt_call.py: using BVCI 35372 18:13:47.185257 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:47.196549 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:47.207957 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:47.219316 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:47.230941 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:47.242414 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:47.366416 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:47.487794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:47.987209 run create_hlr_db(pid=15215): Launched 18:13:48.113839 bus /sierra_2: Setting Powered False 18:13:49.178057 run create_hlr_db(pid=15215): Terminated: ok {rc=0} 18:13:49.611205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Launched 18:13:49.913744 run osmo-hlr_10.42.42.2(pid=15218): Launched 18:13:50.028194 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:50.550523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Launched 18:13:50.853555 run osmo-stp_10.42.42.5(pid=15221): Launched 18:13:50.978767 tst emergency_mo_mt_call.py: using MSISDN 8259 18:13:51.142986 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:51.687130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15223): Launched 18:13:51.991452 run osmo-msc_10.42.42.6(pid=15224): Launched 18:13:52.161988 run osmo-stp_10.42.42.5(pid=15221): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] 18:13:52.288677 run osmo-stp_10.42.42.5(pid=15221): stdout: | (launched: 2022-12-13_18:13:50.797060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:52.415523 run osmo-stp_10.42.42.5(pid=15221): stderr: | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181350965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181350965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181350966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181350966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:52.541122 run osmo-stp_10.42.42.5(pid=15221): stdout: | (launched: 2022-12-13_18:13:50.797060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:52.661447 run osmo-stp_10.42.42.5(pid=15221): stderr: | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181350964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181350965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181350965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181350966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181350966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:52.805516 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15221): Process ended prematurely: osmo-stp_10.42.42.5(pid=15221) [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 18:13:52.814526 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:13:52.841335 run osmo-hlr_10.42.42.2(pid=15218): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15218)] 18:13:52.889382 run osmo-hlr_10.42.42.2(pid=15218): stdout: | (launched: 2022-12-13_18:13:49.857942) 18:13:52.939216 run osmo-hlr_10.42.42.2(pid=15218): stderr: | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181350030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181350042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181350053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181350053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181350053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:53.008904 run osmo-msc_10.42.42.6(pid=15224): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15224)] 18:13:53.057064 run osmo-msc_10.42.42.6(pid=15224): stdout: | (launched: 2022-12-13_18:13:51.935049) 18:13:53.106571 run osmo-msc_10.42.42.6(pid=15224): stderr: | [0;m[38;5;43m20221213181352204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181352204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f85fb0bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181352204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181352205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181352205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181352205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181352207 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181352207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181352207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181352207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:53.156742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Terminating (SIGTERM) 18:13:53.196848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Terminating (SIGTERM) 18:13:53.236913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15223): Terminating (SIGTERM) 18:13:53.277330 --- ParallelTerminationStrategy: PID 15217 died... 18:13:53.296231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Terminated: ok {rc=0} 18:13:53.340523 --- ParallelTerminationStrategy: PID 15220 died... 18:13:53.359331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Terminated: ok {rc=0} 18:13:53.403691 --- ParallelTerminationStrategy: PID 15223 died... 18:13:53.422798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15223): Terminated: ok {rc=0} 18:13:53.508133 bus /sierra_3: Setting Powered False 18:13:54.605325 bus /sierra_3: Setting Powered False 18:13:55.718202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 18:13:56.806458 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:56.818605 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:56.860692 tst emergency_preemptive_call.py: using LAC 35372 18:13:56.991356 tst emergency_preemptive_call.py: using RAC 182 18:13:57.110467 tst emergency_preemptive_call.py: using CellId 35372 18:13:57.226738 tst emergency_preemptive_call.py: using BVCI 35373 18:13:57.347636 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:57.358936 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:57.370208 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:57.381441 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:57.393386 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:57.405196 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:57.524407 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:57.642561 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:57.762798 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:57.878920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:58.347326 run create_hlr_db(pid=15226): Launched 18:13:58.471698 bus /sierra_2: Setting Powered False 18:13:59.531855 run create_hlr_db(pid=15226): Terminated: ok {rc=0} 18:13:59.973935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15228): Launched 18:14:00.300363 run osmo-hlr_10.42.42.2(pid=15229): Launched 18:14:00.426979 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:01.006292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15231): Launched 18:14:01.344217 run osmo-stp_10.42.42.5(pid=15232): Launched 18:14:01.641679 tst emergency_preemptive_call.py: using MSISDN 8260 18:14:01.846170 run osmo-msc_10.42.42.6: Starting osmo-msc 18:14:02.401819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15234): Launched 18:14:02.704696 run osmo-msc_10.42.42.6(pid=15235): Launched 18:14:02.872617 run osmo-stp_10.42.42.5(pid=15232): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15232)] 18:14:03.000274 run osmo-stp_10.42.42.5(pid=15232): stdout: | (launched: 2022-12-13_18:14:01.282878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:03.127552 run osmo-stp_10.42.42.5(pid=15232): stderr: | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181401560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:03.253561 run osmo-stp_10.42.42.5(pid=15232): stdout: | (launched: 2022-12-13_18:14:01.282878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:03.374153 run osmo-stp_10.42.42.5(pid=15232): stderr: | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181401559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181401560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181401560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:03.518388 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15232): Process ended prematurely: osmo-stp_10.42.42.5(pid=15232) [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15232)] [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 18:14:03.526989 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 18:14:03.553755 run osmo-hlr_10.42.42.2(pid=15229): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15229)] 18:14:03.602293 run osmo-hlr_10.42.42.2(pid=15229): stdout: | (launched: 2022-12-13_18:14:00.240783) 18:14:03.652370 run osmo-hlr_10.42.42.2(pid=15229): stderr: | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181400436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181400453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181400463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181400463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181400463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:03.722445 run osmo-msc_10.42.42.6(pid=15235): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15235)] 18:14:03.770775 run osmo-msc_10.42.42.6(pid=15235): stdout: | (launched: 2022-12-13_18:14:02.648519) 18:14:03.820844 run osmo-msc_10.42.42.6(pid=15235): stderr: | [0;m[38;5;43m20221213181402919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181402919 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07ff93bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181402919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181402919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181402919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181402920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181402921 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181402922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181402922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181402922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:14:03.871195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15228): Terminating (SIGTERM) 18:14:03.911562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15231): Terminating (SIGTERM) 18:14:03.952096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15234): Terminating (SIGTERM) 18:14:03.992787 --- ParallelTerminationStrategy: PID 15228 died... 18:14:04.012392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15228): Terminated: ok {rc=0} 18:14:04.057406 --- ParallelTerminationStrategy: PID 15231 died... 18:14:04.076311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15231): Terminated: ok {rc=0} 18:14:04.121440 --- ParallelTerminationStrategy: PID 15234 died... 18:14:04.140454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15234): Terminated: ok {rc=0} 18:14:04.228091 bus /sierra_9: Setting Powered False 18:14:05.329898 bus /sierra_9: Setting Powered False 18:14:06.448633 bus /sierra_8: Setting Powered False 18:14:07.548321 bus /sierra_8: Setting Powered False 18:14:08.665476 bus /sierra_3: Setting Powered False 18:14:09.765363 bus /sierra_3: Setting Powered False 18:14:10.882614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900 --------------------------------------------------------------------- 18:14:12.154705 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:14:12.159857 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:14:12.183242 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 18:14:12.221233 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:14:12.307286 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:14:12.330817 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 18:14:12.368495 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:14:12.965130 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 18:14:13.018322 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.029065 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:13.065761 tst cs_paging_gprs_active.py: using LAC 35373 18:14:13.186167 tst cs_paging_gprs_active.py: using RAC 183 18:14:13.305267 tst cs_paging_gprs_active.py: using CellId 35373 18:14:13.424844 tst cs_paging_gprs_active.py: using BVCI 35374 18:14:13.536273 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.547003 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.557473 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.567914 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.578382 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.588710 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.599281 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.609719 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:13.620386 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:13.740430 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:13.859820 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:14:14.066606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:14.376030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Launched 18:14:14.645649 run iperf3-srv_10.42.42.10(pid=15241): Launched 18:14:14.761760 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:14:14.968127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:15.280542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Launched 18:14:15.550895 run iperf3-srv_10.42.42.10(pid=15243): Launched 18:14:15.666500 tst cs_paging_gprs_active.py:38: start network... 18:14:15.873938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:16.364505 run create_hlr_db(pid=15244): Launched 18:14:16.523583 bus /sierra_2: Setting Powered False 18:14:17.585733 run create_hlr_db(pid=15244): Terminated: ok {rc=0} 18:14:18.016563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15246): Launched 18:14:18.326510 run osmo-hlr_10.42.42.2(pid=15247): Launched 18:14:18.446262 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:18.975616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15249): Launched 18:14:19.286177 run osmo-stp_10.42.42.5(pid=15250): Launched 18:14:19.405871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:19.935652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15252): Launched 18:14:20.054814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:20.316763 run patchelf(pid=15253): Launched 18:14:20.489544 run osmo-stp_10.42.42.5(pid=15250): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15250)] 18:14:20.620148 run osmo-stp_10.42.42.5(pid=15250): stdout: | (launched: 2022-12-13_18:14:19.229051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:20.752417 run osmo-stp_10.42.42.5(pid=15250): stderr: | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181419399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:20.884892 run osmo-stp_10.42.42.5(pid=15250): stdout: | (launched: 2022-12-13_18:14:19.229051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:21.011315 run osmo-stp_10.42.42.5(pid=15250): stderr: | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181419398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181419399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181419399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:21.161751 run patchelf(pid=15253): Terminating (SIGINT) 18:14:21.337548 run patchelf(pid=15253): Terminated: ok {rc=0} 18:14:21.464239 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15250): Process ended prematurely: osmo-stp_10.42.42.5(pid=15250) [trial-2392↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15250)] [trial-2392↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 18:14:21.473880 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:14:21.501186 run osmo-hlr_10.42.42.2(pid=15247): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15247)] 18:14:21.549648 run osmo-hlr_10.42.42.2(pid=15247): stdout: | (launched: 2022-12-13_18:14:18.269567) 18:14:21.599644 run osmo-hlr_10.42.42.2(pid=15247): stderr: | [0;m[1;31m20221213181418444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181418444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181418444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181418445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181418445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181418445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181418457 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181418465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181418465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181418465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:21.650234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Terminating (SIGTERM) 18:14:21.690635 run iperf3-srv_10.42.42.10(pid=15241): Terminating (SIGTERM) 18:14:21.730824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Terminating (SIGTERM) 18:14:21.771202 run iperf3-srv_10.42.42.10(pid=15243): Terminating (SIGTERM) 18:14:21.811313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15246): Terminating (SIGTERM) 18:14:21.851576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15249): Terminating (SIGTERM) 18:14:21.892619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15252): Terminating (SIGTERM) 18:14:21.933185 --- ParallelTerminationStrategy: PID 15240 died... 18:14:21.952520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Terminated: ok {rc=0} 18:14:21.997127 --- ParallelTerminationStrategy: PID 15241 died... 18:14:22.015883 run iperf3-srv_10.42.42.10(pid=15241): Terminated {rc=256} 18:14:22.059924 --- ParallelTerminationStrategy: PID 15242 died... 18:14:22.078791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Terminated: ok {rc=0} 18:14:22.122940 --- ParallelTerminationStrategy: PID 15243 died... 18:14:22.141721 run iperf3-srv_10.42.42.10(pid=15243): Terminated {rc=256} 18:14:22.186037 --- ParallelTerminationStrategy: PID 15246 died... 18:14:22.204850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15246): Terminated: ok {rc=0} 18:14:22.249311 --- ParallelTerminationStrategy: PID 15249 died... 18:14:22.268018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15249): Terminated: ok {rc=0} 18:14:22.312396 --- ParallelTerminationStrategy: PID 15252 died... 18:14:22.331143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15252): Terminated: ok {rc=0} 18:14:22.415711 bus /gobi_0: Setting Powered False 18:14:23.515427 bus /gobi_0: Setting Powered False 18:14:24.633427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 18:14:25.784857 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.796761 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:25.837184 tst iperf3.py: using LAC 35374 18:14:25.965203 tst iperf3.py: using RAC 184 18:14:26.094693 tst iperf3.py: using CellId 35374 18:14:26.222950 tst iperf3.py: using BVCI 35375 18:14:26.344177 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.355714 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.366904 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.377942 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.389222 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.400579 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.411926 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.423145 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:26.434893 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:26.560413 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:26.781138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:27.110454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Launched 18:14:27.398359 run iperf3-srv_10.42.42.10(pid=15256): Launched 18:14:27.522187 tst iperf3.py:8: start network... 18:14:27.743927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:28.252316 run create_hlr_db(pid=15257): Launched 18:14:28.377962 bus /gobi_6: Setting Powered False 18:14:29.443040 run create_hlr_db(pid=15257): Terminated: ok {rc=0} 18:14:29.882012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15259): Launched 18:14:30.190783 run osmo-hlr_10.42.42.2(pid=15260): Launched 18:14:30.308729 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:30.853787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15262): Launched 18:14:31.207231 run osmo-stp_10.42.42.5(pid=15263): Launched 18:14:31.450486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:32.101784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15265): Launched 18:14:32.231400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:32.493646 run patchelf(pid=15266): Launched 18:14:32.666829 run osmo-stp_10.42.42.5(pid=15263): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15263)] 18:14:32.797661 run osmo-stp_10.42.42.5(pid=15263): stdout: | (launched: 2022-12-13_18:14:31.146488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:32.930297 run osmo-stp_10.42.42.5(pid=15263): stderr: | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181431458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:33.062602 run osmo-stp_10.42.42.5(pid=15263): stdout: | (launched: 2022-12-13_18:14:31.146488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:33.189403 run osmo-stp_10.42.42.5(pid=15263): stderr: | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181431457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181431458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181431458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:33.338668 run patchelf(pid=15266): Terminating (SIGINT) 18:14:33.514678 run patchelf(pid=15266): Terminated: ok {rc=0} 18:14:33.641245 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15263): Process ended prematurely: osmo-stp_10.42.42.5(pid=15263) [trial-2392↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15263)] [trial-2392↪gprs:nanobts+band-1900↪iperf3.py:8] 18:14:33.650756 tst iperf3.py:8: Test FAILED (7.9 sec) 18:14:33.678315 run osmo-hlr_10.42.42.2(pid=15260): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15260)] 18:14:33.726552 run osmo-hlr_10.42.42.2(pid=15260): stdout: | (launched: 2022-12-13_18:14:30.133259) 18:14:33.776428 run osmo-hlr_10.42.42.2(pid=15260): stderr: | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181430307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181430320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181430329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181430329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181430329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:33.827242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Terminating (SIGTERM) 18:14:33.867589 run iperf3-srv_10.42.42.10(pid=15256): Terminating (SIGTERM) 18:14:33.907681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15259): Terminating (SIGTERM) 18:14:33.947984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15262): Terminating (SIGTERM) 18:14:33.988245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15265): Terminating (SIGTERM) 18:14:34.028864 --- ParallelTerminationStrategy: PID 15255 died... 18:14:34.048463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Terminated: ok {rc=0} 18:14:34.093417 --- ParallelTerminationStrategy: PID 15256 died... 18:14:34.112433 run iperf3-srv_10.42.42.10(pid=15256): Terminated {rc=256} 18:14:34.156888 --- ParallelTerminationStrategy: PID 15259 died... 18:14:34.176409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15259): Terminated: ok {rc=0} 18:14:34.220791 --- ParallelTerminationStrategy: PID 15262 died... 18:14:34.240303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15262): Terminated: ok {rc=0} 18:14:34.285353 --- ParallelTerminationStrategy: PID 15265 died... 18:14:34.304419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15265): Terminated: ok {rc=0} 18:14:34.389654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 18:14:35.535227 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:35.546892 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:35.586294 tst iperf3m4.py: using LAC 35375 18:14:35.715948 tst iperf3m4.py: using RAC 185 18:14:35.837104 tst iperf3m4.py: using CellId 35375 18:14:35.960163 tst iperf3m4.py: using BVCI 35376 18:14:36.072870 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.083794 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.094693 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.105598 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.116232 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.126890 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.137695 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.148434 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:36.159359 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:36.281793 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:36.402570 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:36.525325 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:36.647975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:36.869207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:37.199493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15267): Launched 18:14:37.486772 run iperf3-srv_10.42.42.10(pid=15268): Launched 18:14:37.611434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:14:37.831902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:38.162092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15269): Launched 18:14:38.449753 run iperf3-srv_10.42.42.10(pid=15270): Launched 18:14:38.574873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:14:38.796119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:39.127241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15271): Launched 18:14:39.416263 run iperf3-srv_10.42.42.10(pid=15272): Launched 18:14:39.541311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:14:39.762123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:40.092458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Launched 18:14:40.381060 run iperf3-srv_10.42.42.10(pid=15274): Launched 18:14:40.506261 tst iperf3m4.py:8: start network... 18:14:40.727447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:41.235693 run create_hlr_db(pid=15275): Launched 18:14:41.369723 bus /gobi_6: Setting Powered False 18:14:42.433631 run create_hlr_db(pid=15275): Terminated: ok {rc=0} 18:14:42.873231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15277): Launched 18:14:43.181990 run osmo-hlr_10.42.42.2(pid=15278): Launched 18:14:43.299368 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:43.846612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15280): Launched 18:14:44.155418 run osmo-stp_10.42.42.5(pid=15281): Launched 18:14:44.273036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:44.803668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15283): Launched 18:14:44.922517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:45.183671 run patchelf(pid=15284): Launched 18:14:45.360213 run osmo-stp_10.42.42.5(pid=15281): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15281)] 18:14:45.491564 run osmo-stp_10.42.42.5(pid=15281): stdout: | (launched: 2022-12-13_18:14:44.097656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:45.624516 run osmo-stp_10.42.42.5(pid=15281): stderr: | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181444267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:45.757346 run osmo-stp_10.42.42.5(pid=15281): stdout: | (launched: 2022-12-13_18:14:44.097656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:45.886550 run osmo-stp_10.42.42.5(pid=15281): stderr: | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181444266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181444267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181444267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:46.039581 run patchelf(pid=15284): Terminating (SIGINT) 18:14:46.219788 run patchelf(pid=15284): Terminated: ok {rc=0} 18:14:46.349796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15281): Process ended prematurely: osmo-stp_10.42.42.5(pid=15281) [trial-2392↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15281)] [trial-2392↪gprs:nanobts+band-1900↪iperf3m4.py:8] 18:14:46.359822 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:14:46.388657 run osmo-hlr_10.42.42.2(pid=15278): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15278)] 18:14:46.437865 run osmo-hlr_10.42.42.2(pid=15278): stdout: | (launched: 2022-12-13_18:14:43.124460) 18:14:46.488760 run osmo-hlr_10.42.42.2(pid=15278): stderr: | [0;m[1;31m20221213181443298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181443298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181443298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181443299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181443299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181443299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181443312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181443320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181443320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181443320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:46.540183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15267): Terminating (SIGTERM) 18:14:46.585436 run iperf3-srv_10.42.42.10(pid=15268): Terminating (SIGTERM) 18:14:46.629560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15269): Terminating (SIGTERM) 18:14:46.671554 run iperf3-srv_10.42.42.10(pid=15270): Terminating (SIGTERM) 18:14:46.715610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15271): Terminating (SIGTERM) 18:14:46.757747 run iperf3-srv_10.42.42.10(pid=15272): Terminating (SIGTERM) 18:14:46.802005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Terminating (SIGTERM) 18:14:46.843955 run iperf3-srv_10.42.42.10(pid=15274): Terminating (SIGTERM) 18:14:46.888257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15277): Terminating (SIGTERM) 18:14:46.929918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15280): Terminating (SIGTERM) 18:14:46.970885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15283): Terminating (SIGTERM) 18:14:47.012084 --- ParallelTerminationStrategy: PID 15267 died... 18:14:47.031954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15267): Terminated: ok {rc=0} 18:14:47.077881 --- ParallelTerminationStrategy: PID 15268 died... 18:14:47.097658 run iperf3-srv_10.42.42.10(pid=15268): Terminated {rc=256} 18:14:47.142900 --- ParallelTerminationStrategy: PID 15269 died... 18:14:47.162478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15269): Terminated: ok {rc=0} 18:14:47.207510 --- ParallelTerminationStrategy: PID 15270 died... 18:14:47.227076 run iperf3-srv_10.42.42.10(pid=15270): Terminated {rc=256} 18:14:47.272544 --- ParallelTerminationStrategy: PID 15271 died... 18:14:47.291770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15271): Terminated: ok {rc=0} 18:14:47.336224 --- ParallelTerminationStrategy: PID 15272 died... 18:14:47.355390 run iperf3-srv_10.42.42.10(pid=15272): Terminated {rc=256} 18:14:47.399799 --- ParallelTerminationStrategy: PID 15273 died... 18:14:47.419029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Terminated: ok {rc=0} 18:14:47.463546 --- ParallelTerminationStrategy: PID 15274 died... 18:14:47.482785 run iperf3-srv_10.42.42.10(pid=15274): Terminated {rc=256} 18:14:47.527188 --- ParallelTerminationStrategy: PID 15277 died... 18:14:47.546315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15277): Terminated: ok {rc=0} 18:14:47.590817 --- ParallelTerminationStrategy: PID 15280 died... 18:14:47.610016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15280): Terminated: ok {rc=0} 18:14:47.654524 --- ParallelTerminationStrategy: PID 15283 died... 18:14:47.673658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15283): Terminated: ok {rc=0} 18:14:47.758279 bus /gobi_4: Setting Powered False 18:14:48.858827 bus /gobi_4: Setting Powered False 18:14:49.977187 bus /gobi_1: Setting Powered False 18:14:51.076302 bus /gobi_1: Setting Powered False 18:14:52.194523 bus /gobi_0: Setting Powered False 18:14:53.294212 bus /gobi_0: Setting Powered False 18:14:54.413127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 18:14:55.515387 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:55.527006 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:55.566792 tst ping.py: using LAC 35376 18:14:55.685114 tst ping.py: using RAC 186 18:14:55.803283 tst ping.py: using CellId 35376 18:14:55.927931 tst ping.py: using BVCI 35377 18:14:56.038699 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.049886 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.060506 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.071099 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.081881 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.092491 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.103472 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:56.114338 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:56.229725 tst ping.py:19: start network... 18:14:56.433820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:56.903919 run create_hlr_db(pid=15285): Launched 18:14:57.027911 bus /gobi_6: Setting Powered False 18:14:58.088575 run create_hlr_db(pid=15285): Terminated: ok {rc=0} 18:14:58.534742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15287): Launched 18:14:58.860131 run osmo-hlr_10.42.42.2(pid=15288): Launched 18:14:58.983720 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:59.549115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15290): Launched 18:14:59.875921 run osmo-stp_10.42.42.5(pid=15291): Launched 18:14:59.999187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:00.560248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15293): Launched 18:15:00.686706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:00.965825 run patchelf(pid=15294): Launched 18:15:01.161721 run osmo-stp_10.42.42.5(pid=15291): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15291)] 18:15:01.302401 run osmo-stp_10.42.42.5(pid=15291): stdout: | (launched: 2022-12-13_18:14:59.815529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:01.446178 run osmo-stp_10.42.42.5(pid=15291): stderr: | [0;m[38;5;43m20221213181500005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181500005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181500006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181500006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:01.589423 run osmo-stp_10.42.42.5(pid=15291): stdout: | (launched: 2022-12-13_18:14:59.815529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:01.726076 run osmo-stp_10.42.42.5(pid=15291): stderr: | [0;m[38;5;43m20221213181500005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181500005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181500006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181500006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181500007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:01.893450 run patchelf(pid=15294): Terminating (SIGINT) 18:15:02.089990 run patchelf(pid=15294): Terminated: ok {rc=0} 18:15:02.226041 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15291): Process ended prematurely: osmo-stp_10.42.42.5(pid=15291) [trial-2392↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15291)] [trial-2392↪gprs:nanobts+band-1900↪ping.py:22] 18:15:02.236660 tst ping.py:22: Test FAILED (6.7 sec) 18:15:02.267714 run osmo-hlr_10.42.42.2(pid=15288): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15288)] 18:15:02.322574 run osmo-hlr_10.42.42.2(pid=15288): stdout: | (launched: 2022-12-13_18:14:58.800184) 18:15:02.378089 run osmo-hlr_10.42.42.2(pid=15288): stderr: | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181458997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181459010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181459019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181459019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:02.434859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15287): Terminating (SIGTERM) 18:15:02.478828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15290): Terminating (SIGTERM) 18:15:02.523588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15293): Terminating (SIGTERM) 18:15:02.569179 --- ParallelTerminationStrategy: PID 15287 died... 18:15:02.591383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15287): Terminated: ok {rc=0} 18:15:02.642260 --- ParallelTerminationStrategy: PID 15290 died... 18:15:02.663467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15290): Terminated: ok {rc=0} 18:15:02.713798 --- ParallelTerminationStrategy: PID 15293 died... 18:15:02.733864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15293): Terminated: ok {rc=0} 18:15:02.825109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 18:15:03.916011 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:03.928135 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:15:03.970493 tst ping_idle_ping.py: using LAC 35377 18:15:04.092326 tst ping_idle_ping.py: using RAC 187 18:15:04.213634 tst ping_idle_ping.py: using CellId 35377 18:15:04.334589 tst ping_idle_ping.py: using BVCI 35378 18:15:04.446974 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.457851 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.468603 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.479196 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.489887 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.500481 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.511341 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:15:04.522251 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:15:04.643200 tst ping_idle_ping.py:24: start network... 18:15:04.864680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:05.373602 run create_hlr_db(pid=15305): Launched 18:15:05.499855 bus /gobi_6: Setting Powered False 18:15:06.564266 run create_hlr_db(pid=15305): Terminated: ok {rc=0} 18:15:07.000265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Launched 18:15:07.307147 run osmo-hlr_10.42.42.2(pid=15308): Launched 18:15:07.425256 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:07.971972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Launched 18:15:08.279276 run osmo-stp_10.42.42.5(pid=15311): Launched 18:15:08.398188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:08.926813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15313): Launched 18:15:09.045589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:09.305229 run patchelf(pid=15314): Launched 18:15:09.477754 run osmo-stp_10.42.42.5(pid=15311): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] 18:15:09.607618 run osmo-stp_10.42.42.5(pid=15311): stdout: | (launched: 2022-12-13_18:15:08.221906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:09.739388 run osmo-stp_10.42.42.5(pid=15311): stderr: | [0;m[38;5;43m20221213181508390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181508391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181508391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181508391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:09.871297 run osmo-stp_10.42.42.5(pid=15311): stdout: | (launched: 2022-12-13_18:15:08.221906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:09.996651 run osmo-stp_10.42.42.5(pid=15311): stderr: | [0;m[38;5;43m20221213181508390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181508391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181508391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181508391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181508392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:10.145623 run patchelf(pid=15314): Terminating (SIGINT) 18:15:10.320111 run patchelf(pid=15314): Terminated: ok {rc=0} 18:15:10.445856 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15311): Process ended prematurely: osmo-stp_10.42.42.5(pid=15311) [trial-2392↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] [trial-2392↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 18:15:10.454732 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:15:10.481839 run osmo-hlr_10.42.42.2(pid=15308): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15308)] 18:15:10.530242 run osmo-hlr_10.42.42.2(pid=15308): stdout: | (launched: 2022-12-13_18:15:07.250373) 18:15:10.580213 run osmo-hlr_10.42.42.2(pid=15308): stderr: | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181507426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181507438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181507446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181507447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181507447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:10.630459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Terminating (SIGTERM) 18:15:10.670620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Terminating (SIGTERM) 18:15:10.710952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15313): Terminating (SIGTERM) 18:15:10.751688 --- ParallelTerminationStrategy: PID 15307 died... 18:15:10.771335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15307): Terminated: ok {rc=0} 18:15:10.816215 --- ParallelTerminationStrategy: PID 15310 died... 18:15:10.835529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15310): Terminated: ok {rc=0} 18:15:10.880236 --- ParallelTerminationStrategy: PID 15313 died... 18:15:10.899462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15313): Terminated: ok {rc=0} 18:15:10.986487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 18:15:12.287979 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:15:12.294652 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:15:12.318607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:15:12.358131 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:15:12.446099 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:15:12.470373 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:15:12.508756 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:15:13.119000 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:15:13.178901 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.190890 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:13.234224 tst cs_paging_gprs_active.py: using LAC 35378 18:15:13.370907 tst cs_paging_gprs_active.py: using RAC 188 18:15:13.504452 tst cs_paging_gprs_active.py: using CellId 35378 18:15:13.631547 tst cs_paging_gprs_active.py: using BVCI 35379 18:15:13.747991 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.759735 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.771092 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.782774 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.794580 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.806067 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.817732 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.829259 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:13.840783 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:13.961600 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:14.083824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:15:14.300134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:14.622893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Launched 18:15:14.930167 run iperf3-srv_10.42.42.10(pid=15671): Launched 18:15:15.054852 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:15:15.278816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:15.614538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Launched 18:15:15.905734 run iperf3-srv_10.42.42.10(pid=15673): Launched 18:15:16.059371 tst cs_paging_gprs_active.py:38: start network... 18:15:16.280553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:16.806359 run create_hlr_db(pid=15674): Launched 18:15:16.968291 bus /gobi_6: Setting Powered False 18:15:18.034347 run create_hlr_db(pid=15674): Terminated: ok {rc=0} 18:15:18.479865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Launched 18:15:18.791982 run osmo-hlr_10.42.42.2(pid=15677): Launched 18:15:18.910433 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:19.444154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Launched 18:15:19.756548 run osmo-stp_10.42.42.5(pid=15680): Launched 18:15:19.875955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:20.413288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Launched 18:15:20.534866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:20.797901 run patchelf(pid=15683): Launched 18:15:20.972922 run osmo-stp_10.42.42.5(pid=15680): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] 18:15:21.105492 run osmo-stp_10.42.42.5(pid=15680): stdout: | (launched: 2022-12-13_18:15:19.698951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:21.238984 run osmo-stp_10.42.42.5(pid=15680): stderr: | [0;m[38;5;43m20221213181519867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181519868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181519868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181519868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:21.372142 run osmo-stp_10.42.42.5(pid=15680): stdout: | (launched: 2022-12-13_18:15:19.698951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:21.498968 run osmo-stp_10.42.42.5(pid=15680): stderr: | [0;m[38;5;43m20221213181519867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181519868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181519868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181519868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181519869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:21.650458 run patchelf(pid=15683): Terminating (SIGINT) 18:15:21.826914 run patchelf(pid=15683): Terminated: ok {rc=0} 18:15:21.954279 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15680): Process ended prematurely: osmo-stp_10.42.42.5(pid=15680) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:15:21.964038 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:15:21.991519 run osmo-hlr_10.42.42.2(pid=15677): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15677)] 18:15:22.039470 run osmo-hlr_10.42.42.2(pid=15677): stdout: | (launched: 2022-12-13_18:15:18.734289) 18:15:22.089534 run osmo-hlr_10.42.42.2(pid=15677): stderr: | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181518909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181518922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181518930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181518930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181518931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:22.139869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminating (SIGTERM) 18:15:22.180001 run iperf3-srv_10.42.42.10(pid=15671): Terminating (SIGTERM) 18:15:22.220243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminating (SIGTERM) 18:15:22.260722 run iperf3-srv_10.42.42.10(pid=15673): Terminating (SIGTERM) 18:15:22.301034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Terminating (SIGTERM) 18:15:22.341294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Terminating (SIGTERM) 18:15:22.381399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Terminating (SIGTERM) 18:15:22.423843 --- ParallelTerminationStrategy: PID 15604 died... 18:15:22.442987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminated: ok {rc=0} 18:15:22.487471 --- ParallelTerminationStrategy: PID 15671 died... 18:15:22.506393 run iperf3-srv_10.42.42.10(pid=15671): Terminated {rc=256} 18:15:22.550714 --- ParallelTerminationStrategy: PID 15672 died... 18:15:22.569711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminated: ok {rc=0} 18:15:22.614231 --- ParallelTerminationStrategy: PID 15673 died... 18:15:22.633130 run iperf3-srv_10.42.42.10(pid=15673): Terminated {rc=256} 18:15:22.677230 --- ParallelTerminationStrategy: PID 15676 died... 18:15:22.696002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Terminated: ok {rc=0} 18:15:22.740311 --- ParallelTerminationStrategy: PID 15679 died... 18:15:22.759344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Terminated: ok {rc=0} 18:15:22.803574 --- ParallelTerminationStrategy: PID 15682 died... 18:15:22.822561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Terminated: ok {rc=0} 18:15:22.909907 bus /gobi_0: Setting Powered False 18:15:24.016082 bus /gobi_0: Setting Powered False 18:15:25.140825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:15:26.298627 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.312054 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:26.360731 tst iperf3.py: using LAC 35379 18:15:26.495407 tst iperf3.py: using RAC 189 18:15:26.628391 tst iperf3.py: using CellId 35379 18:15:26.762448 tst iperf3.py: using BVCI 35380 18:15:26.887372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.900115 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.912363 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.926859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.938970 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.953121 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.966651 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.979785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:26.993363 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:27.123471 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:27.353545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:27.701059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15859): Launched 18:15:28.009173 run iperf3-srv_10.42.42.10(pid=15860): Launched 18:15:28.151021 tst iperf3.py:8: start network... 18:15:28.381867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:28.917276 run create_hlr_db(pid=15861): Launched 18:15:29.083628 bus /gobi_6: Setting Powered False 18:15:30.148919 run create_hlr_db(pid=15861): Terminated: ok {rc=0} 18:15:30.623787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Launched 18:15:30.963551 run osmo-hlr_10.42.42.2(pid=15865): Launched 18:15:31.237029 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:31.828239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Launched 18:15:32.162685 run osmo-stp_10.42.42.5(pid=15868): Launched 18:15:32.347387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:32.905703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15870): Launched 18:15:33.027239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:33.291466 run patchelf(pid=15871): Launched 18:15:33.467425 run osmo-stp_10.42.42.5(pid=15868): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] 18:15:33.599852 run osmo-stp_10.42.42.5(pid=15868): stdout: | (launched: 2022-12-13_18:15:32.101435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:33.733978 run osmo-stp_10.42.42.5(pid=15868): stderr: | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181532438 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181532438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181532438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181532439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:33.867219 run osmo-stp_10.42.42.5(pid=15868): stdout: | (launched: 2022-12-13_18:15:32.101435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:33.994287 run osmo-stp_10.42.42.5(pid=15868): stderr: | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181532437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181532438 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181532438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181532438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181532439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:34.144694 run patchelf(pid=15871): Terminating (SIGINT) 18:15:34.322142 run patchelf(pid=15871): Terminated: ok {rc=0} 18:15:34.449515 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15868): Process ended prematurely: osmo-stp_10.42.42.5(pid=15868) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 18:15:34.458894 tst iperf3.py:8: Test FAILED (8.2 sec) 18:15:34.486460 run osmo-hlr_10.42.42.2(pid=15865): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15865)] 18:15:34.534355 run osmo-hlr_10.42.42.2(pid=15865): stdout: | (launched: 2022-12-13_18:15:30.899913) 18:15:34.584538 run osmo-hlr_10.42.42.2(pid=15865): stderr: | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181531111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181531127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181531143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181531143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181531143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:34.634859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15859): Terminating (SIGTERM) 18:15:34.675236 run iperf3-srv_10.42.42.10(pid=15860): Terminating (SIGTERM) 18:15:34.715575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Terminating (SIGTERM) 18:15:34.755826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Terminating (SIGTERM) 18:15:34.796631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15870): Terminating (SIGTERM) 18:15:34.837406 --- ParallelTerminationStrategy: PID 15859 died... 18:15:34.856572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15859): Terminated: ok {rc=0} 18:15:34.901225 --- ParallelTerminationStrategy: PID 15860 died... 18:15:34.920119 run iperf3-srv_10.42.42.10(pid=15860): Terminated {rc=256} 18:15:34.964769 --- ParallelTerminationStrategy: PID 15864 died... 18:15:34.983648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15864): Terminated: ok {rc=0} 18:15:35.027976 --- ParallelTerminationStrategy: PID 15867 died... 18:15:35.046888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15867): Terminated: ok {rc=0} 18:15:35.091240 --- ParallelTerminationStrategy: PID 15870 died... 18:15:35.110148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15870): Terminated: ok {rc=0} 18:15:35.197067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:15:36.347559 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.359208 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:36.400652 tst iperf3m4.py: using LAC 35380 18:15:36.532512 tst iperf3m4.py: using RAC 190 18:15:36.662698 tst iperf3m4.py: using CellId 35380 18:15:36.791945 tst iperf3m4.py: using BVCI 35381 18:15:36.912743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.924391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.935713 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.947015 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.958564 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.970193 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.981903 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:36.993319 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:37.005082 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:37.125565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:37.249552 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:37.369577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:37.490475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:37.701557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:38.016031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15872): Launched 18:15:38.292433 run iperf3-srv_10.42.42.10(pid=15873): Launched 18:15:38.410054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:15:38.618228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:38.931859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15874): Launched 18:15:39.207528 run iperf3-srv_10.42.42.10(pid=15875): Launched 18:15:39.326539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:15:39.535427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:39.851847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15876): Launched 18:15:40.128250 run iperf3-srv_10.42.42.10(pid=15877): Launched 18:15:40.247237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:15:40.456163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:40.771813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15878): Launched 18:15:41.047763 run iperf3-srv_10.42.42.10(pid=15879): Launched 18:15:41.166684 tst iperf3m4.py:8: start network... 18:15:41.375798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:41.861549 run create_hlr_db(pid=15880): Launched 18:15:41.990553 bus /gobi_6: Setting Powered False 18:15:43.052929 run create_hlr_db(pid=15880): Terminated: ok {rc=0} 18:15:43.510536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Launched 18:15:43.848055 run osmo-hlr_10.42.42.2(pid=15883): Launched 18:15:43.977152 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:44.555947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Launched 18:15:44.891400 run osmo-stp_10.42.42.5(pid=15886): Launched 18:15:45.019553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:45.594063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15888): Launched 18:15:45.722640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:46.015282 run patchelf(pid=15889): Launched 18:15:46.207640 run osmo-stp_10.42.42.5(pid=15886): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] 18:15:46.345280 run osmo-stp_10.42.42.5(pid=15886): stdout: | (launched: 2022-12-13_18:15:44.829973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:46.483379 run osmo-stp_10.42.42.5(pid=15886): stderr: | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181545022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:46.622677 run osmo-stp_10.42.42.5(pid=15886): stdout: | (launched: 2022-12-13_18:15:44.829973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:46.755427 run osmo-stp_10.42.42.5(pid=15886): stderr: | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181545021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181545022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181545022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:46.911255 run patchelf(pid=15889): Terminating (SIGINT) 18:15:47.094573 run patchelf(pid=15889): Terminated: ok {rc=0} 18:15:47.225866 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15886): Process ended prematurely: osmo-stp_10.42.42.5(pid=15886) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 18:15:47.235401 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:15:47.263436 run osmo-hlr_10.42.42.2(pid=15883): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15883)] 18:15:47.311751 run osmo-hlr_10.42.42.2(pid=15883): stdout: | (launched: 2022-12-13_18:15:43.786371) 18:15:47.362132 run osmo-hlr_10.42.42.2(pid=15883): stderr: | [0;m[1;31m20221213181543984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181543984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181543984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181543984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181543985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181543985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181543996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181544005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181544006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181544006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:47.412775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15872): Terminating (SIGTERM) 18:15:47.453532 run iperf3-srv_10.42.42.10(pid=15873): Terminating (SIGTERM) 18:15:47.494062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15874): Terminating (SIGTERM) 18:15:47.534650 run iperf3-srv_10.42.42.10(pid=15875): Terminating (SIGTERM) 18:15:47.574855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15876): Terminating (SIGTERM) 18:15:47.615354 run iperf3-srv_10.42.42.10(pid=15877): Terminating (SIGTERM) 18:15:47.655623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15878): Terminating (SIGTERM) 18:15:47.696136 run iperf3-srv_10.42.42.10(pid=15879): Terminating (SIGTERM) 18:15:47.736923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Terminating (SIGTERM) 18:15:47.777837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Terminating (SIGTERM) 18:15:47.818219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15888): Terminating (SIGTERM) 18:15:47.858966 --- ParallelTerminationStrategy: PID 15872 died... 18:15:47.878144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15872): Terminated: ok {rc=0} 18:15:47.923080 --- ParallelTerminationStrategy: PID 15873 died... 18:15:47.942069 run iperf3-srv_10.42.42.10(pid=15873): Terminated {rc=256} 18:15:47.986528 --- ParallelTerminationStrategy: PID 15874 died... 18:15:48.005509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15874): Terminated: ok {rc=0} 18:15:48.050302 --- ParallelTerminationStrategy: PID 15875 died... 18:15:48.069217 run iperf3-srv_10.42.42.10(pid=15875): Terminated {rc=256} 18:15:48.113638 --- ParallelTerminationStrategy: PID 15876 died... 18:15:48.132554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15876): Terminated: ok {rc=0} 18:15:48.177362 --- ParallelTerminationStrategy: PID 15877 died... 18:15:48.196286 run iperf3-srv_10.42.42.10(pid=15877): Terminated {rc=256} 18:15:48.240800 --- ParallelTerminationStrategy: PID 15878 died... 18:15:48.260193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15878): Terminated: ok {rc=0} 18:15:48.304937 --- ParallelTerminationStrategy: PID 15879 died... 18:15:48.324014 run iperf3-srv_10.42.42.10(pid=15879): Terminated {rc=256} 18:15:48.369297 --- ParallelTerminationStrategy: PID 15882 died... 18:15:48.388253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Terminated: ok {rc=0} 18:15:48.433307 --- ParallelTerminationStrategy: PID 15885 died... 18:15:48.452345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Terminated: ok {rc=0} 18:15:48.497223 --- ParallelTerminationStrategy: PID 15888 died... 18:15:48.516396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15888): Terminated: ok {rc=0} 18:15:48.604787 bus /gobi_4: Setting Powered False 18:15:49.705921 bus /gobi_4: Setting Powered False 18:15:50.822555 bus /gobi_1: Setting Powered False 18:15:51.921757 bus /gobi_1: Setting Powered False 18:15:53.038208 bus /gobi_0: Setting Powered False 18:15:54.137817 bus /gobi_0: Setting Powered False 18:15:55.254069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 18:15:56.358863 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.370982 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:56.417230 tst ping.py: using LAC 35381 18:15:56.536614 tst ping.py: using RAC 191 18:15:56.655039 tst ping.py: using CellId 35381 18:15:56.775016 tst ping.py: using BVCI 35382 18:15:56.884664 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.895766 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.906850 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.917565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.928252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.938999 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.949935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:56.960590 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:57.080286 tst ping.py:19: start network... 18:15:57.285743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:57.755026 run create_hlr_db(pid=15892): Launched 18:15:57.880624 bus /gobi_6: Setting Powered False 18:15:58.941253 run create_hlr_db(pid=15892): Terminated: ok {rc=0} 18:15:59.385498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15894): Launched 18:15:59.713202 run osmo-hlr_10.42.42.2(pid=15895): Launched 18:15:59.838328 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:00.406958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15897): Launched 18:16:00.733425 run osmo-stp_10.42.42.5(pid=15898): Launched 18:16:00.906572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:01.540312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15900): Launched 18:16:01.675300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:01.943900 run patchelf(pid=15901): Launched 18:16:02.133633 run osmo-stp_10.42.42.5(pid=15898): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15898)] 18:16:02.264239 run osmo-stp_10.42.42.5(pid=15898): stdout: | (launched: 2022-12-13_18:16:00.673428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:02.395169 run osmo-stp_10.42.42.5(pid=15898): stderr: | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181600879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:02.526876 run osmo-stp_10.42.42.5(pid=15898): stdout: | (launched: 2022-12-13_18:16:00.673428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:02.651321 run osmo-stp_10.42.42.5(pid=15898): stderr: | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181600879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181600879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181600880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:02.799019 run patchelf(pid=15901): Terminating (SIGINT) 18:16:02.971902 run patchelf(pid=15901): Terminated: ok {rc=0} 18:16:03.096251 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15898): Process ended prematurely: osmo-stp_10.42.42.5(pid=15898) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15898)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 18:16:03.105450 tst ping.py:22: Test FAILED (6.7 sec) 18:16:03.132852 run osmo-hlr_10.42.42.2(pid=15895): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15895)] 18:16:03.181620 run osmo-hlr_10.42.42.2(pid=15895): stdout: | (launched: 2022-12-13_18:15:59.652551) 18:16:03.231944 run osmo-hlr_10.42.42.2(pid=15895): stderr: | [0;m[1;31m20221213181559853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181559853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181559853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181559853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181559853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181559854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181559866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181559874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181559875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181559875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:03.282775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15894): Terminating (SIGTERM) 18:16:03.323173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15897): Terminating (SIGTERM) 18:16:03.363506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15900): Terminating (SIGTERM) 18:16:03.411560 --- ParallelTerminationStrategy: PID 15894 died... 18:16:03.435542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15894): Terminated: ok {rc=0} 18:16:03.490917 --- ParallelTerminationStrategy: PID 15897 died... 18:16:03.513537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15897): Terminated: ok {rc=0} 18:16:03.558417 --- ParallelTerminationStrategy: PID 15900 died... 18:16:03.577538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15900): Terminated: ok {rc=0} 18:16:03.664765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:16:04.752250 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:04.763925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:16:04.806736 tst ping_idle_ping.py: using LAC 35382 18:16:04.926958 tst ping_idle_ping.py: using RAC 192 18:16:05.048547 tst ping_idle_ping.py: using CellId 35382 18:16:05.168645 tst ping_idle_ping.py: using BVCI 35383 18:16:05.280203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.291293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.302156 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.312927 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.323800 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.334718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.345677 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:16:05.356324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:16:05.479031 tst ping_idle_ping.py:24: start network... 18:16:05.700373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:06.215290 run create_hlr_db(pid=15902): Launched 18:16:06.341148 bus /gobi_6: Setting Powered False 18:16:07.406709 run create_hlr_db(pid=15902): Terminated: ok {rc=0} 18:16:07.848404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Launched 18:16:08.158474 run osmo-hlr_10.42.42.2(pid=15905): Launched 18:16:08.276210 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:08.806380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Launched 18:16:09.115231 run osmo-stp_10.42.42.5(pid=15908): Launched 18:16:09.234528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:09.762730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15910): Launched 18:16:09.881898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:10.141805 run patchelf(pid=15911): Launched 18:16:10.313600 run osmo-stp_10.42.42.5(pid=15908): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] 18:16:10.443571 run osmo-stp_10.42.42.5(pid=15908): stdout: | (launched: 2022-12-13_18:16:09.057876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:10.575541 run osmo-stp_10.42.42.5(pid=15908): stderr: | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181609230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:10.707468 run osmo-stp_10.42.42.5(pid=15908): stdout: | (launched: 2022-12-13_18:16:09.057876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:10.832837 run osmo-stp_10.42.42.5(pid=15908): stderr: | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181609229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181609230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181609230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:10.981432 run patchelf(pid=15911): Terminating (SIGINT) 18:16:11.155599 run patchelf(pid=15911): Terminated: ok {rc=0} 18:16:11.281306 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15908): Process ended prematurely: osmo-stp_10.42.42.5(pid=15908) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:16:11.290245 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:16:11.317382 run osmo-hlr_10.42.42.2(pid=15905): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15905)] 18:16:11.365778 run osmo-hlr_10.42.42.2(pid=15905): stdout: | (launched: 2022-12-13_18:16:08.100829) 18:16:11.415668 run osmo-hlr_10.42.42.2(pid=15905): stderr: | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181608276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181608288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181608298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181608298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181608298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:11.465967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Terminating (SIGTERM) 18:16:11.506567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Terminating (SIGTERM) 18:16:11.547156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15910): Terminating (SIGTERM) 18:16:11.587864 --- ParallelTerminationStrategy: PID 15904 died... 18:16:11.607328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Terminated: ok {rc=0} 18:16:11.652209 --- ParallelTerminationStrategy: PID 15907 died... 18:16:11.671235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Terminated: ok {rc=0} 18:16:11.715630 --- ParallelTerminationStrategy: PID 15910 died... 18:16:11.734581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15910): Terminated: ok {rc=0} 18:16:11.822277 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:16:13.118996 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:16:13.125789 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:16:13.149489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:16:13.187939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:16:13.273504 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:16:13.297103 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:16:13.334957 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:16:13.937855 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:16:13.994270 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.005790 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:14.066910 tst cs_paging_gprs_active.py: using LAC 35383 18:16:14.195479 tst cs_paging_gprs_active.py: using RAC 193 18:16:14.324914 tst cs_paging_gprs_active.py: using CellId 35383 18:16:14.453949 tst cs_paging_gprs_active.py: using BVCI 35384 18:16:14.568756 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.579912 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.590826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.601739 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.612433 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.623260 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.634170 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.644928 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:14.655881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:14.777952 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:14.897583 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:16:15.107133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:15.421280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Launched 18:16:15.694319 run iperf3-srv_10.42.42.10(pid=15916): Launched 18:16:15.813450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:16:16.029136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:16.349029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15917): Launched 18:16:16.638643 run iperf3-srv_10.42.42.10(pid=15918): Launched 18:16:16.793895 tst cs_paging_gprs_active.py:38: start network... 18:16:17.025830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:17.550430 run create_hlr_db(pid=15919): Launched 18:16:17.680492 bus /gobi_6: Setting Powered False 18:16:18.742716 run create_hlr_db(pid=15919): Terminated: ok {rc=0} 18:16:19.197448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Launched 18:16:19.535723 run osmo-hlr_10.42.42.2(pid=15922): Launched 18:16:19.665278 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:20.238943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Launched 18:16:20.572707 run osmo-stp_10.42.42.5(pid=15925): Launched 18:16:20.700420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:21.272439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15927): Launched 18:16:21.402204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:21.683965 run patchelf(pid=15928): Launched 18:16:21.870766 run osmo-stp_10.42.42.5(pid=15925): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] 18:16:22.012754 run osmo-stp_10.42.42.5(pid=15925): stdout: | (launched: 2022-12-13_18:16:20.511327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:22.155561 run osmo-stp_10.42.42.5(pid=15925): stderr: | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181620705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:22.297784 run osmo-stp_10.42.42.5(pid=15925): stdout: | (launched: 2022-12-13_18:16:20.511327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:22.434033 run osmo-stp_10.42.42.5(pid=15925): stderr: | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181620705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181620705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181620706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:22.595232 run patchelf(pid=15928): Terminating (SIGINT) 18:16:22.783473 run patchelf(pid=15928): Terminated: ok {rc=0} 18:16:22.919084 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15925): Process ended prematurely: osmo-stp_10.42.42.5(pid=15925) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:16:22.929656 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:16:22.959033 run osmo-hlr_10.42.42.2(pid=15922): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15922)] 18:16:23.010998 run osmo-hlr_10.42.42.2(pid=15922): stdout: | (launched: 2022-12-13_18:16:19.474421) 18:16:23.064243 run osmo-hlr_10.42.42.2(pid=15922): stderr: | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181619684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181619694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181619695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181619695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:23.117876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Terminating (SIGTERM) 18:16:23.160522 run iperf3-srv_10.42.42.10(pid=15916): Terminating (SIGTERM) 18:16:23.203615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15917): Terminating (SIGTERM) 18:16:23.246680 run iperf3-srv_10.42.42.10(pid=15918): Terminating (SIGTERM) 18:16:23.289737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Terminating (SIGTERM) 18:16:23.332849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Terminating (SIGTERM) 18:16:23.376129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15927): Terminating (SIGTERM) 18:16:23.419788 --- ParallelTerminationStrategy: PID 15915 died... 18:16:23.440735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Terminated: ok {rc=0} 18:16:23.488536 --- ParallelTerminationStrategy: PID 15916 died... 18:16:23.508876 run iperf3-srv_10.42.42.10(pid=15916): Terminated {rc=256} 18:16:23.555845 --- ParallelTerminationStrategy: PID 15917 died... 18:16:23.576160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15917): Terminated: ok {rc=0} 18:16:23.623307 --- ParallelTerminationStrategy: PID 15918 died... 18:16:23.643556 run iperf3-srv_10.42.42.10(pid=15918): Terminated {rc=256} 18:16:23.690550 --- ParallelTerminationStrategy: PID 15921 died... 18:16:23.710879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Terminated: ok {rc=0} 18:16:23.757878 --- ParallelTerminationStrategy: PID 15924 died... 18:16:23.778090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Terminated: ok {rc=0} 18:16:23.824936 --- ParallelTerminationStrategy: PID 15927 died... 18:16:23.845327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15927): Terminated: ok {rc=0} 18:16:23.935369 bus /gobi_0: Setting Powered False 18:16:25.034795 bus /gobi_0: Setting Powered False 18:16:26.153941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:16:27.306937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.319322 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:27.383822 tst iperf3.py: using LAC 35384 18:16:27.514567 tst iperf3.py: using RAC 194 18:16:27.644022 tst iperf3.py: using CellId 35384 18:16:27.767933 tst iperf3.py: using BVCI 35385 18:16:27.882109 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.893476 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.904390 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.915809 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.927257 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.938738 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.950319 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.961813 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:27.973436 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:28.092921 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:16:28.301644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:28.615167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Launched 18:16:28.888056 run iperf3-srv_10.42.42.10(pid=15930): Launched 18:16:29.007206 tst iperf3.py:8: start network... 18:16:29.214797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:29.695658 run create_hlr_db(pid=15931): Launched 18:16:29.822012 bus /gobi_6: Setting Powered False 18:16:30.914715 run create_hlr_db(pid=15931): Terminated: ok {rc=0} 18:16:31.381775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Launched 18:16:31.706373 run osmo-hlr_10.42.42.2(pid=15934): Launched 18:16:31.954577 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:32.641369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Launched 18:16:32.975454 run osmo-stp_10.42.42.5(pid=15937): Launched 18:16:33.103961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:33.676211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Launched 18:16:33.804738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:34.086012 run patchelf(pid=15940): Launched 18:16:34.273917 run osmo-stp_10.42.42.5(pid=15937): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] 18:16:34.415692 run osmo-stp_10.42.42.5(pid=15937): stdout: | (launched: 2022-12-13_18:16:32.914333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:34.558755 run osmo-stp_10.42.42.5(pid=15937): stderr: | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181633107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:34.701985 run osmo-stp_10.42.42.5(pid=15937): stdout: | (launched: 2022-12-13_18:16:32.914333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:34.838321 run osmo-stp_10.42.42.5(pid=15937): stderr: | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181633106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181633107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181633107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:35.000095 run patchelf(pid=15940): Terminating (SIGINT) 18:16:35.189789 run patchelf(pid=15940): Terminated: ok {rc=0} 18:16:35.326284 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15937): Process ended prematurely: osmo-stp_10.42.42.5(pid=15937) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:16:35.336710 tst iperf3.py:8: Test FAILED (8.1 sec) 18:16:35.365816 run osmo-hlr_10.42.42.2(pid=15934): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15934)] 18:16:35.417874 run osmo-hlr_10.42.42.2(pid=15934): stdout: | (launched: 2022-12-13_18:16:31.647519) 18:16:35.470928 run osmo-hlr_10.42.42.2(pid=15934): stderr: | [0;m[1;31m20221213181631988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181631988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181631988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181631988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181631994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181631994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181632014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181632026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181632027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181632027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:35.524352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminating (SIGTERM) 18:16:35.566985 run iperf3-srv_10.42.42.10(pid=15930): Terminating (SIGTERM) 18:16:35.609775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Terminating (SIGTERM) 18:16:35.652525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Terminating (SIGTERM) 18:16:35.695072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Terminating (SIGTERM) 18:16:35.738149 --- ParallelTerminationStrategy: PID 15929 died... 18:16:35.758771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminated: ok {rc=0} 18:16:35.806646 --- ParallelTerminationStrategy: PID 15930 died... 18:16:35.826808 run iperf3-srv_10.42.42.10(pid=15930): Terminated {rc=256} 18:16:35.873764 --- ParallelTerminationStrategy: PID 15933 died... 18:16:35.893949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Terminated: ok {rc=0} 18:16:35.940918 --- ParallelTerminationStrategy: PID 15936 died... 18:16:35.961558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Terminated: ok {rc=0} 18:16:36.008625 --- ParallelTerminationStrategy: PID 15939 died... 18:16:36.029136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Terminated: ok {rc=0} 18:16:36.119120 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:16:37.269172 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.281073 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:37.341518 tst iperf3m4.py: using LAC 35385 18:16:37.463645 tst iperf3m4.py: using RAC 195 18:16:37.587818 tst iperf3m4.py: using CellId 35385 18:16:37.710523 tst iperf3m4.py: using BVCI 35386 18:16:37.825410 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.836304 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.847108 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.857965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.868827 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.879919 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.890978 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.901905 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:37.912937 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:38.031365 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:38.157570 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:38.276307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:38.399246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:16:38.624071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:38.957608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15941): Launched 18:16:39.250794 run iperf3-srv_10.42.42.10(pid=15942): Launched 18:16:39.376889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:16:39.600627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:39.934519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15943): Launched 18:16:40.224782 run iperf3-srv_10.42.42.10(pid=15944): Launched 18:16:40.351031 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:16:40.574958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:40.908228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15945): Launched 18:16:41.199612 run iperf3-srv_10.42.42.10(pid=15946): Launched 18:16:41.325770 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:16:41.549138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:41.882661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15947): Launched 18:16:42.172406 run iperf3-srv_10.42.42.10(pid=15948): Launched 18:16:42.299683 tst iperf3m4.py:8: start network... 18:16:42.523660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:43.037767 run create_hlr_db(pid=15949): Launched 18:16:43.165824 bus /gobi_6: Setting Powered False 18:16:44.231538 run create_hlr_db(pid=15949): Terminated: ok {rc=0} 18:16:44.693875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Launched 18:16:45.028455 run osmo-hlr_10.42.42.2(pid=15952): Launched 18:16:45.157612 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:45.727369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Launched 18:16:46.077553 run osmo-stp_10.42.42.5(pid=15955): Launched 18:16:46.339770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:47.008383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Launched 18:16:47.148539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:47.433850 run patchelf(pid=15958): Launched 18:16:47.619918 run osmo-stp_10.42.42.5(pid=15955): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] 18:16:47.760674 run osmo-stp_10.42.42.5(pid=15955): stdout: | (launched: 2022-12-13_18:16:46.015618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:47.903548 run osmo-stp_10.42.42.5(pid=15955): stderr: | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181646294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:48.045852 run osmo-stp_10.42.42.5(pid=15955): stdout: | (launched: 2022-12-13_18:16:46.015618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:48.182119 run osmo-stp_10.42.42.5(pid=15955): stderr: | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181646293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181646294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181646294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:48.344048 run patchelf(pid=15958): Terminating (SIGINT) 18:16:48.533884 run patchelf(pid=15958): Terminated: ok {rc=0} 18:16:48.669725 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15955): Process ended prematurely: osmo-stp_10.42.42.5(pid=15955) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:16:48.679979 tst iperf3m4.py:8: Test FAILED (11.4 sec) 18:16:48.709374 run osmo-hlr_10.42.42.2(pid=15952): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15952)] 18:16:48.761085 run osmo-hlr_10.42.42.2(pid=15952): stdout: | (launched: 2022-12-13_18:16:44.966799) 18:16:48.813924 run osmo-hlr_10.42.42.2(pid=15952): stderr: | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181645166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181645179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181645188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181645188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181645188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:48.866958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15941): Terminating (SIGTERM) 18:16:48.909380 run iperf3-srv_10.42.42.10(pid=15942): Terminating (SIGTERM) 18:16:48.952030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15943): Terminating (SIGTERM) 18:16:48.994643 run iperf3-srv_10.42.42.10(pid=15944): Terminating (SIGTERM) 18:16:49.037148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15945): Terminating (SIGTERM) 18:16:49.079522 run iperf3-srv_10.42.42.10(pid=15946): Terminating (SIGTERM) 18:16:49.122244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15947): Terminating (SIGTERM) 18:16:49.164738 run iperf3-srv_10.42.42.10(pid=15948): Terminating (SIGTERM) 18:16:49.207080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Terminating (SIGTERM) 18:16:49.249738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Terminating (SIGTERM) 18:16:49.292135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Terminating (SIGTERM) 18:16:49.334886 --- ParallelTerminationStrategy: PID 15941 died... 18:16:49.355638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15941): Terminated: ok {rc=0} 18:16:49.402762 --- ParallelTerminationStrategy: PID 15942 died... 18:16:49.423197 run iperf3-srv_10.42.42.10(pid=15942): Terminated {rc=256} 18:16:49.470393 --- ParallelTerminationStrategy: PID 15943 died... 18:16:49.490678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15943): Terminated: ok {rc=0} 18:16:49.537752 --- ParallelTerminationStrategy: PID 15944 died... 18:16:49.557793 run iperf3-srv_10.42.42.10(pid=15944): Terminated {rc=256} 18:16:49.604605 --- ParallelTerminationStrategy: PID 15945 died... 18:16:49.624867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15945): Terminated: ok {rc=0} 18:16:49.671740 --- ParallelTerminationStrategy: PID 15946 died... 18:16:49.691824 run iperf3-srv_10.42.42.10(pid=15946): Terminated {rc=256} 18:16:49.738677 --- ParallelTerminationStrategy: PID 15947 died... 18:16:49.758905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15947): Terminated: ok {rc=0} 18:16:49.805890 --- ParallelTerminationStrategy: PID 15948 died... 18:16:49.826049 run iperf3-srv_10.42.42.10(pid=15948): Terminated {rc=256} 18:16:49.872891 --- ParallelTerminationStrategy: PID 15951 died... 18:16:49.893650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Terminated: ok {rc=0} 18:16:49.940708 --- ParallelTerminationStrategy: PID 15954 died... 18:16:49.961056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Terminated: ok {rc=0} 18:16:50.007888 --- ParallelTerminationStrategy: PID 15957 died... 18:16:50.028070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Terminated: ok {rc=0} 18:16:50.118306 bus /gobi_4: Setting Powered False 18:16:51.219010 bus /gobi_4: Setting Powered False 18:16:52.338661 bus /gobi_1: Setting Powered False 18:16:53.438455 bus /gobi_1: Setting Powered False 18:16:54.553255 bus /gobi_0: Setting Powered False 18:16:55.654440 bus /gobi_0: Setting Powered False 18:16:56.772358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:16:57.877458 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:57.889826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:57.953452 tst ping.py: using LAC 35386 18:16:58.081677 tst ping.py: using RAC 196 18:16:58.211033 tst ping.py: using CellId 35386 18:16:58.343074 tst ping.py: using BVCI 35387 18:16:58.463489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.475202 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.486591 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.498074 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.509662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.521370 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.533105 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:58.544714 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:58.663615 tst ping.py:19: start network... 18:16:58.869146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:59.341089 run create_hlr_db(pid=15959): Launched 18:16:59.468649 bus /gobi_6: Setting Powered False 18:17:00.529903 run create_hlr_db(pid=15959): Terminated: ok {rc=0} 18:17:00.959645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Launched 18:17:01.313410 run osmo-hlr_10.42.42.2(pid=15962): Launched 18:17:01.602950 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:02.250049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Launched 18:17:02.593883 run osmo-stp_10.42.42.5(pid=15968): Launched 18:17:02.721489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:17:03.286503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15970): Launched 18:17:03.412331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:17:03.689493 run patchelf(pid=15971): Launched 18:17:03.871932 run osmo-stp_10.42.42.5(pid=15968): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] 18:17:04.009919 run osmo-stp_10.42.42.5(pid=15968): stdout: | (launched: 2022-12-13_18:17:02.532941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:04.149746 run osmo-stp_10.42.42.5(pid=15968): stderr: | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181702726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:04.289786 run osmo-stp_10.42.42.5(pid=15968): stdout: | (launched: 2022-12-13_18:17:02.532941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:04.423395 run osmo-stp_10.42.42.5(pid=15968): stderr: | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181702725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181702726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181702726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:04.581964 run patchelf(pid=15971): Terminating (SIGINT) 18:17:04.765764 run patchelf(pid=15971): Terminated: ok {rc=0} 18:17:04.898184 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15968): Process ended prematurely: osmo-stp_10.42.42.5(pid=15968) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 18:17:04.907914 tst ping.py:22: Test FAILED (7.0 sec) 18:17:04.936477 run osmo-hlr_10.42.42.2(pid=15962): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15962)] 18:17:04.987811 run osmo-hlr_10.42.42.2(pid=15962): stdout: | (launched: 2022-12-13_18:17:01.254014) 18:17:05.041097 run osmo-hlr_10.42.42.2(pid=15962): stderr: | [0;m[1;31m20221213181701515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181701515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181701516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181701516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181701516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181701516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181701535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181701559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181701560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181701561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:05.094456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Terminating (SIGTERM) 18:17:05.137182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Terminating (SIGTERM) 18:17:05.179891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15970): Terminating (SIGTERM) 18:17:05.222855 --- ParallelTerminationStrategy: PID 15961 died... 18:17:05.243554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Terminated: ok {rc=0} 18:17:05.291480 --- ParallelTerminationStrategy: PID 15967 died... 18:17:05.311711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15967): Terminated: ok {rc=0} 18:17:05.358999 --- ParallelTerminationStrategy: PID 15970 died... 18:17:05.379111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15970): Terminated: ok {rc=0} 18:17:05.468599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:17:06.556369 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:06.568664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:17:06.631807 tst ping_idle_ping.py: using LAC 35387 18:17:06.760376 tst ping_idle_ping.py: using RAC 197 18:17:06.889369 tst ping_idle_ping.py: using CellId 35387 18:17:07.017385 tst ping_idle_ping.py: using BVCI 35388 18:17:07.134988 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.146676 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.157930 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.169255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.180772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.192489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.204322 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:17:07.215934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:17:07.336033 tst ping_idle_ping.py:24: start network... 18:17:07.542763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:08.018579 run create_hlr_db(pid=15972): Launched 18:17:08.144501 bus /gobi_6: Setting Powered False 18:17:09.206774 run create_hlr_db(pid=15972): Terminated: ok {rc=0} 18:17:09.654957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15974): Launched 18:17:09.983213 run osmo-hlr_10.42.42.2(pid=15975): Launched 18:17:10.109633 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:10.672810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15977): Launched 18:17:11.000880 run osmo-stp_10.42.42.5(pid=15978): Launched 18:17:11.125118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:17:11.687421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15980): Launched 18:17:11.813707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:17:12.089864 run patchelf(pid=15981): Launched 18:17:12.272298 run osmo-stp_10.42.42.5(pid=15978): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15978)] 18:17:12.410896 run osmo-stp_10.42.42.5(pid=15978): stdout: | (launched: 2022-12-13_18:17:10.940323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:12.552143 run osmo-stp_10.42.42.5(pid=15978): stderr: | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181711132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:12.692365 run osmo-stp_10.42.42.5(pid=15978): stdout: | (launched: 2022-12-13_18:17:10.940323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:12.826316 run osmo-stp_10.42.42.5(pid=15978): stderr: | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181711131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181711132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181711132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:12.984662 run patchelf(pid=15981): Terminating (SIGINT) 18:17:13.170119 run patchelf(pid=15981): Terminated: ok {rc=0} 18:17:13.303244 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15978): Process ended prematurely: osmo-stp_10.42.42.5(pid=15978) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15978)] [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:17:13.312847 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:17:13.341446 run osmo-hlr_10.42.42.2(pid=15975): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15975)] 18:17:13.393071 run osmo-hlr_10.42.42.2(pid=15975): stdout: | (launched: 2022-12-13_18:17:09.923061) 18:17:13.446179 run osmo-hlr_10.42.42.2(pid=15975): stderr: | [0;m[1;31m20221213181710120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181710120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181710120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181710120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181710121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181710121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181710134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181710142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181710142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181710142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:13.499211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15974): Terminating (SIGTERM) 18:17:13.541517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15977): Terminating (SIGTERM) 18:17:13.584591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15980): Terminating (SIGTERM) 18:17:13.627593 --- ParallelTerminationStrategy: PID 15974 died... 18:17:13.648380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15974): Terminated: ok {rc=0} 18:17:13.695641 --- ParallelTerminationStrategy: PID 15977 died... 18:17:13.715935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15977): Terminated: ok {rc=0} 18:17:13.762981 --- ParallelTerminationStrategy: PID 15980 died... 18:17:13.783219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15980): Terminated: ok {rc=0} 18:17:13.873596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:17:15.173804 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:15.182617 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:17:15.207687 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:17:15.244714 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:17:15.299005 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:17:15.323678 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:17:15.359704 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:17:15.951570 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:17:15.958529 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:15.971353 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:17:16.040140 tst switch_tch_pdch.py: using LAC 35388 18:17:16.202017 tst switch_tch_pdch.py: using RAC 198 18:17:16.333289 tst switch_tch_pdch.py: using CellId 35388 18:17:16.495940 tst switch_tch_pdch.py: using BVCI 35389 18:17:16.642653 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.655899 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.668865 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.682036 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.697227 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.711381 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.725581 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:17:16.739924 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:17:16.867604 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:17:17.013654 tst switch_tch_pdch.py:51: start network... 18:17:17.282223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:17.759806 run create_hlr_db(pid=15986): Launched 18:17:17.883824 bus /gobi_6: Setting Powered False 18:17:18.944145 run create_hlr_db(pid=15986): Terminated: ok {rc=0} 18:17:19.390963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15988): Launched 18:17:19.719113 run osmo-hlr_10.42.42.2(pid=15989): Launched 18:17:19.845875 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:20.411503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15991): Launched 18:17:20.739414 run osmo-stp_10.42.42.5(pid=15992): Launched 18:17:20.866654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:17:21.428526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15994): Launched 18:17:21.554911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:17:21.830402 run patchelf(pid=15995): Launched 18:17:22.013048 run osmo-stp_10.42.42.5(pid=15992): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15992)] 18:17:22.150806 run osmo-stp_10.42.42.5(pid=15992): stdout: | (launched: 2022-12-13_18:17:20.679088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:22.290559 run osmo-stp_10.42.42.5(pid=15992): stderr: | [0;m[38;5;43m20221213181720869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181720869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181720870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181720870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:22.430431 run osmo-stp_10.42.42.5(pid=15992): stdout: | (launched: 2022-12-13_18:17:20.679088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:22.564605 run osmo-stp_10.42.42.5(pid=15992): stderr: | [0;m[38;5;43m20221213181720869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181720869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181720870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181720870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181720871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:22.722639 run patchelf(pid=15995): Terminating (SIGINT) 18:17:22.906522 run patchelf(pid=15995): Terminated: ok {rc=0} 18:17:23.039159 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15992): Process ended prematurely: osmo-stp_10.42.42.5(pid=15992) [trial-2392↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15992)] [trial-2392↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:17:23.048996 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 18:17:23.077817 run osmo-hlr_10.42.42.2(pid=15989): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15989)] 18:17:23.129379 run osmo-hlr_10.42.42.2(pid=15989): stdout: | (launched: 2022-12-13_18:17:19.658875) 18:17:23.182043 run osmo-hlr_10.42.42.2(pid=15989): stderr: | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181719856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181719869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181719879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181719879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181719879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:23.234970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15988): Terminating (SIGTERM) 18:17:23.277346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15991): Terminating (SIGTERM) 18:17:23.319955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15994): Terminating (SIGTERM) 18:17:23.362818 --- ParallelTerminationStrategy: PID 15988 died... 18:17:23.383520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15988): Terminated: ok {rc=0} 18:17:23.430512 --- ParallelTerminationStrategy: PID 15991 died... 18:17:23.450925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15991): Terminated: ok {rc=0} 18:17:23.497912 --- ParallelTerminationStrategy: PID 15994 died... 18:17:23.518054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15994): Terminated: ok {rc=0} 18:17:23.606729 bus /gobi_0: Setting Powered False 18:17:24.706501 bus /gobi_0: Setting Powered False 18:17:25.824923 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 sms:nanobts+band-900 --------------------------------------------------------------------- 18:17:27.074336 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:27.079847 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:17:27.113280 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:17:27.142568 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 18:17:27.195946 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:17:27.229145 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:17:27.256659 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 18:17:27.805318 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 18:17:27.810839 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:27.822284 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 18:17:27.875045 tst mo_mt_sms.py: using LAC 35389 18:17:28.001550 tst mo_mt_sms.py: using RAC 199 18:17:28.129137 tst mo_mt_sms.py: using CellId 35389 18:17:28.254229 tst mo_mt_sms.py: using BVCI 35390 18:17:28.372073 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:28.383335 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:28.394607 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:28.405578 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:28.417001 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:28.428345 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:17:28.547047 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:17:28.667252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:29.148685 run create_hlr_db(pid=15999): Launched 18:17:29.273827 bus /gobi_6: Setting Powered False 18:17:30.335141 run create_hlr_db(pid=15999): Terminated: ok {rc=0} 18:17:30.782899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Launched 18:17:31.133363 run osmo-hlr_10.42.42.2(pid=16002): Launched 18:17:31.370884 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:31.993491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Launched 18:17:32.317199 run osmo-stp_10.42.42.5(pid=16005): Launched 18:17:32.434503 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:32.986687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16007): Launched 18:17:33.294638 run osmo-msc_10.42.42.6(pid=16008): Launched 18:17:33.466486 run osmo-stp_10.42.42.5(pid=16005): ERR: Terminated: ERROR {rc=1} [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16005)] 18:17:33.595455 run osmo-stp_10.42.42.5(pid=16005): stdout: | (launched: 2022-12-13_18:17:32.259125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:33.724155 run osmo-stp_10.42.42.5(pid=16005): stderr: | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181732430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:33.851400 run osmo-stp_10.42.42.5(pid=16005): stdout: | (launched: 2022-12-13_18:17:32.259125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:33.972460 run osmo-stp_10.42.42.5(pid=16005): stderr: | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181732429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181732430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181732430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:34.117894 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16005): Process ended prematurely: osmo-stp_10.42.42.5(pid=16005) [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16005)] [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py:16] 18:17:34.126394 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 18:17:34.152886 run osmo-hlr_10.42.42.2(pid=16002): ERR: Terminated: ERROR {rc=237} [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16002)] 18:17:34.201402 run osmo-hlr_10.42.42.2(pid=16002): stdout: | (launched: 2022-12-13_18:17:31.072062) 18:17:34.251262 run osmo-hlr_10.42.42.2(pid=16002): stderr: | [0;m[1;31m20221213181731398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181731398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181731398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181731399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181731399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181731399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181731422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181731440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181731440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181731440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:34.320761 run osmo-msc_10.42.42.6(pid=16008): ERR: Terminated: ERROR {rc=2} [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16008)] 18:17:34.369235 run osmo-msc_10.42.42.6(pid=16008): stdout: | (launched: 2022-12-13_18:17:33.237486) 18:17:34.418986 run osmo-msc_10.42.42.6(pid=16008): stderr: | [0;m[38;5;43m20221213181733512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181733513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbff0417c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181733513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181733513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181733513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181733513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181733515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181733515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181733516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181733516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:34.469406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Terminating (SIGTERM) 18:17:34.509463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Terminating (SIGTERM) 18:17:34.549480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16007): Terminating (SIGTERM) 18:17:34.590602 --- ParallelTerminationStrategy: PID 16001 died... 18:17:34.610316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Terminated: ok {rc=0} 18:17:34.654886 --- ParallelTerminationStrategy: PID 16004 died... 18:17:34.673978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Terminated: ok {rc=0} 18:17:34.718398 --- ParallelTerminationStrategy: PID 16007 died... 18:17:34.737445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16007): Terminated: ok {rc=0} 18:17:34.824455 bus /sierra_3: Setting Powered False 18:17:35.925077 bus /sierra_3: Setting Powered False 18:17:37.040457 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 18:17:38.272524 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:38.277225 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:17:38.309264 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 18:17:38.316125 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:17:38.350903 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:17:38.382942 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 18:17:38.389764 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:17:38.910286 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:17:38.915534 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 18:17:38.926579 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:17:38.972125 tst assert_extension.py: using LAC 35390 18:17:39.092661 tst assert_extension.py: using RAC 200 18:17:39.213000 tst assert_extension.py: using CellId 35390 18:17:39.331552 tst assert_extension.py: using BVCI 35391 18:17:39.442664 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:17:39.556443 tst assert_extension.py:10: start nitb and bts... 18:17:39.760661 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:17:40.381100 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16013): Launched 18:17:40.689266 run osmo-nitb_10.42.42.2(pid=16014): Launched 18:17:40.858477 run osmo-nitb_10.42.42.2(pid=16014): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16014)] 18:17:40.995530 run osmo-nitb_10.42.42.2(pid=16014): stdout: | (launched: 2022-12-13_18:17:40.632037) 18:17:41.133547 run osmo-nitb_10.42.42.2(pid=16014): stderr: | (launched: 2022-12-13_18:17:40.677504) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:41.271727 run osmo-nitb_10.42.42.2(pid=16014): stdout: | (launched: 2022-12-13_18:17:40.632037) 18:17:41.403442 run osmo-nitb_10.42.42.2(pid=16014): stderr: | (launched: 2022-12-13_18:17:40.677504) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16014) [trial-2392↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16014)] 18:17:41.804281 tst osmo-nitb_10.42.42.2(pid=16014): stdout: | (launched: 2022-12-13_18:17:40.632037) 18:17:41.927624 tst osmo-nitb_10.42.42.2(pid=16014): stderr: | (launched: 2022-12-13_18:17:40.677504) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:42.073111 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16014) [trial-2392↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16014)] [trial-2392↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 18:17:42.081506 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:17:42.088218 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16013): Terminating (SIGTERM) 18:17:42.297397 --- ParallelTerminationStrategy: PID 16013 died... 18:17:42.317940 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16013): Terminated: ok {rc=0} 18:17:42.404590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 ussd:nanobts+band-900 --------------------------------------------------------------------- 18:17:43.582922 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:43.588363 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:17:43.621494 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:17:43.649900 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:17:43.687848 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:17:43.720861 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:17:43.747721 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:17:44.278517 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:17:44.283828 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.295071 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:17:44.344215 tst assert_extension.py: using LAC 35391 18:17:44.466001 tst assert_extension.py: using RAC 201 18:17:44.587374 tst assert_extension.py: using CellId 35391 18:17:44.707052 tst assert_extension.py: using BVCI 35392 18:17:44.818344 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.829055 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.839636 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.850152 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.860576 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:44.871078 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:17:44.984493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:45.455105 run create_hlr_db(pid=16021): Launched 18:17:45.580311 bus /sierra_2: Setting Powered False 18:17:46.643438 run create_hlr_db(pid=16021): Terminated: ok {rc=0} 18:17:47.107322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16023): Launched 18:17:47.445493 run osmo-hlr_10.42.42.2(pid=16024): Launched 18:17:47.575182 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:48.143711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16026): Launched 18:17:48.471344 run osmo-stp_10.42.42.5(pid=16027): Launched 18:17:48.597697 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:49.185735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16029): Launched 18:17:49.514469 run osmo-msc_10.42.42.6(pid=16030): Launched 18:17:49.698291 run osmo-stp_10.42.42.5(pid=16027): ERR: Terminated: ERROR {rc=1} [trial-2392↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16027)] 18:17:49.835913 run osmo-stp_10.42.42.5(pid=16027): stdout: | (launched: 2022-12-13_18:17:48.410414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:49.974739 run osmo-stp_10.42.42.5(pid=16027): stderr: | [0;m[38;5;43m20221213181748603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181748603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181748604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181748604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:50.111048 run osmo-stp_10.42.42.5(pid=16027): stdout: | (launched: 2022-12-13_18:17:48.410414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:50.240783 run osmo-stp_10.42.42.5(pid=16027): stderr: | [0;m[38;5;43m20221213181748603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181748603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181748604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181748604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181748605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:50.396140 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16027): Process ended prematurely: osmo-stp_10.42.42.5(pid=16027) [trial-2392↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16027)] [trial-2392↪ussd:nanobts+band-900↪assert_extension.py:17] 18:17:50.405240 tst assert_extension.py:17: Test FAILED (6.1 sec) 18:17:50.433055 run osmo-hlr_10.42.42.2(pid=16024): ERR: Terminated: ERROR {rc=237} [trial-2392↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16024)] 18:17:50.484733 run osmo-hlr_10.42.42.2(pid=16024): stdout: | (launched: 2022-12-13_18:17:47.384806) 18:17:50.537719 run osmo-hlr_10.42.42.2(pid=16024): stderr: | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181747582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181747595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181747603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181747604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181747604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:50.611821 run osmo-msc_10.42.42.6(pid=16030): ERR: Terminated: ERROR {rc=2} [trial-2392↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16030)] 18:17:50.662458 run osmo-msc_10.42.42.6(pid=16030): stdout: | (launched: 2022-12-13_18:17:49.453779) 18:17:50.715228 run osmo-msc_10.42.42.6(pid=16030): stderr: | [0;m[38;5;43m20221213181749777 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181749777 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b5615ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181749778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181749778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181749778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181749778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181749780 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181749780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181749780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181749780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:50.768463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16023): Terminating (SIGTERM) 18:17:50.811258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16026): Terminating (SIGTERM) 18:17:50.854483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16029): Terminating (SIGTERM) 18:17:50.897537 --- ParallelTerminationStrategy: PID 16023 died... 18:17:50.918193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16023): Terminated: ok {rc=0} 18:17:50.965553 --- ParallelTerminationStrategy: PID 16026 died... 18:17:50.985780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16026): Terminated: ok {rc=0} 18:17:51.032827 --- ParallelTerminationStrategy: PID 16029 died... 18:17:51.053470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16029): Terminated: ok {rc=0} 18:17:51.143257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:17:52.358367 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:52.366557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:17:52.399691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:17:52.428035 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:17:52.483993 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:17:52.516216 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:17:52.542765 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:17:53.094946 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:17:53.149699 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.161531 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:17:53.230345 tst mo_mt_call.py: using LAC 35392 18:17:53.359158 tst mo_mt_call.py: using RAC 202 18:17:53.488927 tst mo_mt_call.py: using CellId 35392 18:17:53.616405 tst mo_mt_call.py: using BVCI 35393 18:17:53.729749 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.741184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.752369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.763477 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.774784 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:53.785815 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:53.909892 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:54.029371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:54.512804 run create_hlr_db(pid=16035): Launched 18:17:54.639144 bus /sierra_2: Setting Powered False 18:17:55.701858 run create_hlr_db(pid=16035): Terminated: ok {rc=0} 18:17:56.155660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16037): Launched 18:17:56.491408 run osmo-hlr_10.42.42.2(pid=16038): Launched 18:17:56.621214 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:57.199016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16040): Launched 18:17:57.534686 run osmo-stp_10.42.42.5(pid=16041): Launched 18:17:57.664158 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:58.264314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16043): Launched 18:17:58.600398 run osmo-msc_10.42.42.6(pid=16044): Launched 18:17:58.787542 run osmo-stp_10.42.42.5(pid=16041): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16041)] 18:17:58.928189 run osmo-stp_10.42.42.5(pid=16041): stdout: | (launched: 2022-12-13_18:17:57.472900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:59.069378 run osmo-stp_10.42.42.5(pid=16041): stderr: | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181757665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:59.208372 run osmo-stp_10.42.42.5(pid=16041): stdout: | (launched: 2022-12-13_18:17:57.472900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:59.340424 run osmo-stp_10.42.42.5(pid=16041): stderr: | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181757665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181757665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181757666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:59.499263 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16041): Process ended prematurely: osmo-stp_10.42.42.5(pid=16041) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16041)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:17:59.509264 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:17:59.537555 run osmo-hlr_10.42.42.2(pid=16038): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16038)] 18:17:59.589160 run osmo-hlr_10.42.42.2(pid=16038): stdout: | (launched: 2022-12-13_18:17:56.429697) 18:17:59.642156 run osmo-hlr_10.42.42.2(pid=16038): stderr: | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181756629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181756641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181756649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181756650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181756650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:59.716271 run osmo-msc_10.42.42.6(pid=16044): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16044)] 18:17:59.767241 run osmo-msc_10.42.42.6(pid=16044): stdout: | (launched: 2022-12-13_18:17:58.538628) 18:17:59.820001 run osmo-msc_10.42.42.6(pid=16044): stderr: | [0;m[38;5;43m20221213181758864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181758864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48e50bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181758864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181758864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181758864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181758865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181758866 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181758867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181758867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181758867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:59.872883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16037): Terminating (SIGTERM) 18:17:59.915799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16040): Terminating (SIGTERM) 18:17:59.959576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16043): Terminating (SIGTERM) 18:18:00.002857 --- ParallelTerminationStrategy: PID 16037 died... 18:18:00.023628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16037): Terminated: ok {rc=0} 18:18:00.070768 --- ParallelTerminationStrategy: PID 16040 died... 18:18:00.091119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16040): Terminated: ok {rc=0} 18:18:00.138356 --- ParallelTerminationStrategy: PID 16043 died... 18:18:00.158624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16043): Terminated: ok {rc=0} 18:18:00.249418 bus /sierra_3: Setting Powered False 18:18:01.346796 bus /sierra_3: Setting Powered False 18:18:02.466965 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:18:03.620730 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:03.633254 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:18:03.703041 tst mo_mt_call_osmux.py: using LAC 35393 18:18:03.834580 tst mo_mt_call_osmux.py: using RAC 203 18:18:03.964041 tst mo_mt_call_osmux.py: using CellId 35393 18:18:04.094838 tst mo_mt_call_osmux.py: using BVCI 35394 18:18:04.217371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:04.229059 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:04.240684 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:04.252228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:04.264132 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:18:04.276136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:18:04.396132 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:18:04.518635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:05.033142 run create_hlr_db(pid=16046): Launched 18:18:05.161395 bus /sierra_2: Setting Powered False 18:18:06.227628 run create_hlr_db(pid=16046): Terminated: ok {rc=0} 18:18:06.673718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16048): Launched 18:18:06.988064 run osmo-hlr_10.42.42.2(pid=16049): Launched 18:18:07.106027 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:07.646868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16051): Launched 18:18:07.961320 run osmo-stp_10.42.42.5(pid=16052): Launched 18:18:08.080654 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:08.644901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16054): Launched 18:18:08.957360 run osmo-msc_10.42.42.6(pid=16055): Launched 18:18:09.133520 run osmo-stp_10.42.42.5(pid=16052): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16052)] 18:18:09.265153 run osmo-stp_10.42.42.5(pid=16052): stdout: | (launched: 2022-12-13_18:18:07.902703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:09.396119 run osmo-stp_10.42.42.5(pid=16052): stderr: | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181808075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:09.525113 run osmo-stp_10.42.42.5(pid=16052): stdout: | (launched: 2022-12-13_18:18:07.902703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:09.648226 run osmo-stp_10.42.42.5(pid=16052): stderr: | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181808074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181808075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181808075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:09.795567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16052): Process ended prematurely: osmo-stp_10.42.42.5(pid=16052) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16052)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:18:09.804741 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:18:09.831555 run osmo-hlr_10.42.42.2(pid=16049): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16049)] 18:18:09.879850 run osmo-hlr_10.42.42.2(pid=16049): stdout: | (launched: 2022-12-13_18:18:06.930200) 18:18:09.929817 run osmo-hlr_10.42.42.2(pid=16049): stderr: | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181807106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181807118 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181807128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181807128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181807128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:09.999849 run osmo-msc_10.42.42.6(pid=16055): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16055)] 18:18:10.047945 run osmo-msc_10.42.42.6(pid=16055): stdout: | (launched: 2022-12-13_18:18:08.899269) 18:18:10.097813 run osmo-msc_10.42.42.6(pid=16055): stderr: | [0;m[38;5;43m20221213181809172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181809172 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc303ab6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181809172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181809172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181809173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181809173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181809174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181809175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181809175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181809175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:10.148045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16048): Terminating (SIGTERM) 18:18:10.188254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16051): Terminating (SIGTERM) 18:18:10.228435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16054): Terminating (SIGTERM) 18:18:10.268931 --- ParallelTerminationStrategy: PID 16048 died... 18:18:10.288355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16048): Terminated: ok {rc=0} 18:18:10.332866 --- ParallelTerminationStrategy: PID 16051 died... 18:18:10.352369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16051): Terminated: ok {rc=0} 18:18:10.396820 --- ParallelTerminationStrategy: PID 16054 died... 18:18:10.416219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16054): Terminated: ok {rc=0} 18:18:10.503564 bus /sierra_3: Setting Powered False 18:18:11.604738 bus /sierra_3: Setting Powered False 18:18:12.720858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:18:13.976715 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:13.984371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:18:14.016298 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:18:14.042682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:18:14.092841 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:18:14.125062 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:18:14.151176 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:18:14.704186 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:18:14.753433 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:14.764489 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:18:14.828846 tst mo_mt_call.py: using LAC 35394 18:18:14.949881 tst mo_mt_call.py: using RAC 204 18:18:15.069562 tst mo_mt_call.py: using CellId 35394 18:18:15.192540 tst mo_mt_call.py: using BVCI 35395 18:18:15.306599 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:15.317875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:15.328942 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:15.339948 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:15.351141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:15.362141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:15.479060 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:15.597163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:16.087318 run create_hlr_db(pid=16060): Launched 18:18:16.251278 bus /sierra_2: Setting Powered False 18:18:17.312561 run create_hlr_db(pid=16060): Terminated: ok {rc=0} 18:18:17.747141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16062): Launched 18:18:18.059980 run osmo-hlr_10.42.42.2(pid=16063): Launched 18:18:18.178166 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:18.713875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16065): Launched 18:18:19.028905 run osmo-stp_10.42.42.5(pid=16066): Launched 18:18:19.146834 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:19.706848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16068): Launched 18:18:20.020180 run osmo-msc_10.42.42.6(pid=16069): Launched 18:18:20.196623 run osmo-stp_10.42.42.5(pid=16066): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16066)] 18:18:20.328121 run osmo-stp_10.42.42.5(pid=16066): stdout: | (launched: 2022-12-13_18:18:18.970644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:20.459098 run osmo-stp_10.42.42.5(pid=16066): stderr: | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181819145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:20.588275 run osmo-stp_10.42.42.5(pid=16066): stdout: | (launched: 2022-12-13_18:18:18.970644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:20.710858 run osmo-stp_10.42.42.5(pid=16066): stderr: | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181819144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181819145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181819145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:20.859500 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16066): Process ended prematurely: osmo-stp_10.42.42.5(pid=16066) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16066)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:18:20.868381 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:18:20.895281 run osmo-hlr_10.42.42.2(pid=16063): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16063)] 18:18:20.943891 run osmo-hlr_10.42.42.2(pid=16063): stdout: | (launched: 2022-12-13_18:18:18.002207) 18:18:20.994004 run osmo-hlr_10.42.42.2(pid=16063): stderr: | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181818180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181818195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181818206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181818206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181818206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:21.063885 run osmo-msc_10.42.42.6(pid=16069): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16069)] 18:18:21.112227 run osmo-msc_10.42.42.6(pid=16069): stdout: | (launched: 2022-12-13_18:18:19.962294) 18:18:21.162114 run osmo-msc_10.42.42.6(pid=16069): stderr: | [0;m[38;5;43m20221213181820234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181820234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c7df61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181820234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181820234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181820235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181820235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181820237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181820237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181820237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181820237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:21.212277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16062): Terminating (SIGTERM) 18:18:21.252295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16065): Terminating (SIGTERM) 18:18:21.292309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16068): Terminating (SIGTERM) 18:18:21.332649 --- ParallelTerminationStrategy: PID 16062 died... 18:18:21.352194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16062): Terminated: ok {rc=0} 18:18:21.397229 --- ParallelTerminationStrategy: PID 16065 died... 18:18:21.416135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16065): Terminated: ok {rc=0} 18:18:21.460391 --- ParallelTerminationStrategy: PID 16068 died... 18:18:21.479465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16068): Terminated: ok {rc=0} 18:18:21.564746 bus /sierra_3: Setting Powered False 18:18:22.664045 bus /sierra_3: Setting Powered False 18:18:23.782415 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:18:24.935116 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:24.947600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:18:25.020819 tst mo_mt_call_osmux.py: using LAC 35395 18:18:25.151087 tst mo_mt_call_osmux.py: using RAC 205 18:18:25.279500 tst mo_mt_call_osmux.py: using CellId 35395 18:18:25.402280 tst mo_mt_call_osmux.py: using BVCI 35396 18:18:25.516402 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:25.527722 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:25.538906 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:25.550153 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:25.561879 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:25.573545 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:25.697593 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:25.820781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:26.335331 run create_hlr_db(pid=16071): Launched 18:18:26.464188 bus /sierra_2: Setting Powered False 18:18:27.530754 run create_hlr_db(pid=16071): Terminated: ok {rc=0} 18:18:27.977421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Launched 18:18:28.291878 run osmo-hlr_10.42.42.2(pid=16074): Launched 18:18:28.411908 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:28.963367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Launched 18:18:29.278128 run osmo-stp_10.42.42.5(pid=16077): Launched 18:18:29.398397 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:29.963504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16079): Launched 18:18:30.278946 run osmo-msc_10.42.42.6(pid=16080): Launched 18:18:30.455300 run osmo-stp_10.42.42.5(pid=16077): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] 18:18:30.586994 run osmo-stp_10.42.42.5(pid=16077): stdout: | (launched: 2022-12-13_18:18:29.219923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:30.719025 run osmo-stp_10.42.42.5(pid=16077): stderr: | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181829395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:30.852091 run osmo-stp_10.42.42.5(pid=16077): stdout: | (launched: 2022-12-13_18:18:29.219923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:30.988572 run osmo-stp_10.42.42.5(pid=16077): stderr: | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181829394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181829395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181829395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:31.140280 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16077): Process ended prematurely: osmo-stp_10.42.42.5(pid=16077) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:18:31.150226 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:18:31.177938 run osmo-hlr_10.42.42.2(pid=16074): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16074)] 18:18:31.227906 run osmo-hlr_10.42.42.2(pid=16074): stdout: | (launched: 2022-12-13_18:18:28.233754) 18:18:31.279364 run osmo-hlr_10.42.42.2(pid=16074): stderr: | [0;m[1;31m20221213181828411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181828424 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181828432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181828432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181828433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:31.351669 run osmo-msc_10.42.42.6(pid=16080): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16080)] 18:18:31.401333 run osmo-msc_10.42.42.6(pid=16080): stdout: | (launched: 2022-12-13_18:18:30.220369) 18:18:31.452333 run osmo-msc_10.42.42.6(pid=16080): stderr: | [0;m[38;5;43m20221213181830495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181830495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1ff635c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181830495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181830495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181830496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181830496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181830498 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181830498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181830498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181830498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:31.504228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Terminating (SIGTERM) 18:18:31.547496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Terminating (SIGTERM) 18:18:31.590493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16079): Terminating (SIGTERM) 18:18:31.632415 --- ParallelTerminationStrategy: PID 16073 died... 18:18:31.652542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Terminated: ok {rc=0} 18:18:31.699649 --- ParallelTerminationStrategy: PID 16076 died... 18:18:31.719466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Terminated: ok {rc=0} 18:18:31.764713 --- ParallelTerminationStrategy: PID 16079 died... 18:18:31.784488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16079): Terminated: ok {rc=0} 18:18:31.873186 bus /sierra_3: Setting Powered False 18:18:32.990745 bus /sierra_3: Setting Powered False 18:18:34.107678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:18:35.356443 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:35.364166 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:18:35.396060 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:18:35.422574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:18:35.474122 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:18:35.505822 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:18:35.531994 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:18:36.084330 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:18:36.134193 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.145555 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:18:36.217457 tst mo_mt_call.py: using LAC 35396 18:18:36.337998 tst mo_mt_call.py: using RAC 206 18:18:36.460050 tst mo_mt_call.py: using CellId 35396 18:18:36.581423 tst mo_mt_call.py: using BVCI 35397 18:18:36.695535 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.706919 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.717939 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.728889 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.739995 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:36.751015 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:36.870200 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:36.993066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:37.507882 run create_hlr_db(pid=16085): Launched 18:18:37.636339 bus /sierra_2: Setting Powered False 18:18:38.702606 run create_hlr_db(pid=16085): Terminated: ok {rc=0} 18:18:39.166356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Launched 18:18:39.502413 run osmo-hlr_10.42.42.2(pid=16088): Launched 18:18:39.631666 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:40.206353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Launched 18:18:40.539608 run osmo-stp_10.42.42.5(pid=16091): Launched 18:18:40.668026 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:41.267671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16093): Launched 18:18:41.602306 run osmo-msc_10.42.42.6(pid=16094): Launched 18:18:41.789409 run osmo-stp_10.42.42.5(pid=16091): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] 18:18:41.929493 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-13_18:18:40.478098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:42.070180 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181840673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:42.208814 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-13_18:18:40.478098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:42.341062 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181840672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181840673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181840673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:42.498967 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:18:42.508459 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:18:42.537018 run osmo-hlr_10.42.42.2(pid=16088): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16088)] 18:18:42.588805 run osmo-hlr_10.42.42.2(pid=16088): stdout: | (launched: 2022-12-13_18:18:39.440522) 18:18:42.642106 run osmo-hlr_10.42.42.2(pid=16088): stderr: | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181839640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181839652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181839661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181839661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181839661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:42.715926 run osmo-msc_10.42.42.6(pid=16094): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16094)] 18:18:42.766694 run osmo-msc_10.42.42.6(pid=16094): stdout: | (launched: 2022-12-13_18:18:41.540128) 18:18:42.819830 run osmo-msc_10.42.42.6(pid=16094): stderr: | [0;m[38;5;43m20221213181841868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181841868 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba2dd7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181841868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181841869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181841869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181841869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181841871 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181841871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181841871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181841871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:42.873177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminating (SIGTERM) 18:18:42.915428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminating (SIGTERM) 18:18:42.958509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16093): Terminating (SIGTERM) 18:18:43.001988 --- ParallelTerminationStrategy: PID 16087 died... 18:18:43.022766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminated: ok {rc=0} 18:18:43.070106 --- ParallelTerminationStrategy: PID 16090 died... 18:18:43.090271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminated: ok {rc=0} 18:18:43.137651 --- ParallelTerminationStrategy: PID 16093 died... 18:18:43.158035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16093): Terminated: ok {rc=0} 18:18:43.247988 bus /sierra_3: Setting Powered False 18:18:44.347441 bus /sierra_3: Setting Powered False 18:18:45.465393 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:18:46.659318 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:46.676258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:18:46.754497 tst mo_mt_call_osmux.py: using LAC 35397 18:18:46.887405 tst mo_mt_call_osmux.py: using RAC 207 18:18:47.010467 tst mo_mt_call_osmux.py: using CellId 35397 18:18:47.167367 tst mo_mt_call_osmux.py: using BVCI 35398 18:18:47.281313 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:47.292418 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:47.303471 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:47.314529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:47.325669 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:47.336696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:47.460625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:47.586597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:48.103250 run create_hlr_db(pid=16096): Launched 18:18:48.231837 bus /sierra_2: Setting Powered False 18:18:49.297728 run create_hlr_db(pid=16096): Terminated: ok {rc=0} 18:18:49.761271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Launched 18:18:50.097214 run osmo-hlr_10.42.42.2(pid=16099): Launched 18:18:50.224306 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:50.799296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Launched 18:18:51.133513 run osmo-stp_10.42.42.5(pid=16102): Launched 18:18:51.261663 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:51.864437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Launched 18:18:52.199791 run osmo-msc_10.42.42.6(pid=16105): Launched 18:18:52.388479 run osmo-stp_10.42.42.5(pid=16102): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] 18:18:52.529484 run osmo-stp_10.42.42.5(pid=16102): stdout: | (launched: 2022-12-13_18:18:51.072074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:52.670965 run osmo-stp_10.42.42.5(pid=16102): stderr: | [0;m[38;5;43m20221213181851263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181851264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181851264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181851264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:52.810182 run osmo-stp_10.42.42.5(pid=16102): stdout: | (launched: 2022-12-13_18:18:51.072074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:52.942877 run osmo-stp_10.42.42.5(pid=16102): stderr: | [0;m[38;5;43m20221213181851263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181851264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181851264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181851264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181851265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:53.101460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16102): Process ended prematurely: osmo-stp_10.42.42.5(pid=16102) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:18:53.111236 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:18:53.139448 run osmo-hlr_10.42.42.2(pid=16099): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16099)] 18:18:53.191383 run osmo-hlr_10.42.42.2(pid=16099): stdout: | (launched: 2022-12-13_18:18:50.035269) 18:18:53.244516 run osmo-hlr_10.42.42.2(pid=16099): stderr: | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181850247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181850257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181850257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181850257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:53.318299 run osmo-msc_10.42.42.6(pid=16105): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16105)] 18:18:53.369348 run osmo-msc_10.42.42.6(pid=16105): stdout: | (launched: 2022-12-13_18:18:52.138281) 18:18:53.422277 run osmo-msc_10.42.42.6(pid=16105): stderr: | [0;m[38;5;43m20221213181852459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181852459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb3b016c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181852459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181852459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181852460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181852460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181852461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181852462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181852462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181852462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:53.475348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Terminating (SIGTERM) 18:18:53.518458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Terminating (SIGTERM) 18:18:53.562132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Terminating (SIGTERM) 18:18:53.605326 --- ParallelTerminationStrategy: PID 16098 died... 18:18:53.626213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Terminated: ok {rc=0} 18:18:53.673736 --- ParallelTerminationStrategy: PID 16101 died... 18:18:53.694013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Terminated: ok {rc=0} 18:18:53.741398 --- ParallelTerminationStrategy: PID 16104 died... 18:18:53.761648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Terminated: ok {rc=0} 18:18:53.851285 bus /sierra_3: Setting Powered False 18:18:54.951945 bus /sierra_3: Setting Powered False 18:18:56.071571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:18:57.321444 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:57.328811 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:18:57.360752 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:18:57.387293 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:18:57.439655 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:18:57.471842 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:18:57.498250 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:18:58.048918 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:18:58.098721 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.109961 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:18:58.179382 tst mo_mt_call.py: using LAC 35398 18:18:58.299949 tst mo_mt_call.py: using RAC 208 18:18:58.421086 tst mo_mt_call.py: using CellId 35398 18:18:58.541284 tst mo_mt_call.py: using BVCI 35399 18:18:58.653425 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.664597 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.675585 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.686579 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.697766 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:58.708722 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:58.832154 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:58.951205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:59.431816 run create_hlr_db(pid=16110): Launched 18:18:59.560693 bus /sierra_2: Setting Powered False 18:19:00.622418 run create_hlr_db(pid=16110): Terminated: ok {rc=0} 18:19:01.081902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16112): Launched 18:19:01.449691 run osmo-hlr_10.42.42.2(pid=16113): Launched 18:19:01.732656 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:02.320430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16115): Launched 18:19:02.644160 run osmo-stp_10.42.42.5(pid=16116): Launched 18:19:02.764320 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:03.329371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16118): Launched 18:19:03.641022 run osmo-msc_10.42.42.6(pid=16119): Launched 18:19:03.815216 run osmo-stp_10.42.42.5(pid=16116): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16116)] 18:19:03.944884 run osmo-stp_10.42.42.5(pid=16116): stdout: | (launched: 2022-12-13_18:19:02.585792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:04.075164 run osmo-stp_10.42.42.5(pid=16116): stderr: | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181902759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:04.204123 run osmo-stp_10.42.42.5(pid=16116): stdout: | (launched: 2022-12-13_18:19:02.585792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:04.326605 run osmo-stp_10.42.42.5(pid=16116): stderr: | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181902758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181902759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181902759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:04.473729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16116): Process ended prematurely: osmo-stp_10.42.42.5(pid=16116) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16116)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:19:04.482624 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:19:04.509410 run osmo-hlr_10.42.42.2(pid=16113): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16113)] 18:19:04.557989 run osmo-hlr_10.42.42.2(pid=16113): stdout: | (launched: 2022-12-13_18:19:01.388132) 18:19:04.607958 run osmo-hlr_10.42.42.2(pid=16113): stderr: | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181901624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181901637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181901652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181901652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181901652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:04.678025 run osmo-msc_10.42.42.6(pid=16119): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16119)] 18:19:04.726091 run osmo-msc_10.42.42.6(pid=16119): stdout: | (launched: 2022-12-13_18:19:03.582881) 18:19:04.775828 run osmo-msc_10.42.42.6(pid=16119): stderr: | [0;m[38;5;43m20221213181903857 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181903857 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ffd050c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181903857 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181903858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181903858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181903858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181903860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181903860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181903860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181903860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:04.826068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16112): Terminating (SIGTERM) 18:19:04.866090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16115): Terminating (SIGTERM) 18:19:04.906196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16118): Terminating (SIGTERM) 18:19:04.946591 --- ParallelTerminationStrategy: PID 16112 died... 18:19:04.965986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16112): Terminated: ok {rc=0} 18:19:05.010190 --- ParallelTerminationStrategy: PID 16115 died... 18:19:05.028850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16115): Terminated: ok {rc=0} 18:19:05.073116 --- ParallelTerminationStrategy: PID 16118 died... 18:19:05.091866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16118): Terminated: ok {rc=0} 18:19:05.176866 bus /sierra_3: Setting Powered False 18:19:06.274585 bus /sierra_3: Setting Powered False 18:19:07.388102 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:19:08.540296 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:08.552660 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:19:08.622216 tst mo_mt_call_osmux.py: using LAC 35399 18:19:08.753188 tst mo_mt_call_osmux.py: using RAC 209 18:19:08.883879 tst mo_mt_call_osmux.py: using CellId 35399 18:19:09.013560 tst mo_mt_call_osmux.py: using BVCI 35400 18:19:09.134458 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:09.146197 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:09.157704 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:09.169147 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:09.181154 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:09.193069 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:09.316140 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:09.436895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:09.951087 run create_hlr_db(pid=16121): Launched 18:19:10.078188 bus /sierra_2: Setting Powered False 18:19:11.144145 run create_hlr_db(pid=16121): Terminated: ok {rc=0} 18:19:11.590701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16123): Launched 18:19:11.906130 run osmo-hlr_10.42.42.2(pid=16124): Launched 18:19:12.026530 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:12.562853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16126): Launched 18:19:12.876407 run osmo-stp_10.42.42.5(pid=16127): Launched 18:19:12.994983 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:13.560469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16129): Launched 18:19:13.872725 run osmo-msc_10.42.42.6(pid=16130): Launched 18:19:14.047590 run osmo-stp_10.42.42.5(pid=16127): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16127)] 18:19:14.179588 run osmo-stp_10.42.42.5(pid=16127): stdout: | (launched: 2022-12-13_18:19:12.818474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:14.310736 run osmo-stp_10.42.42.5(pid=16127): stderr: | [0;m[38;5;43m20221213181912989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181912989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181912990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181912990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:14.439860 run osmo-stp_10.42.42.5(pid=16127): stdout: | (launched: 2022-12-13_18:19:12.818474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:14.563111 run osmo-stp_10.42.42.5(pid=16127): stderr: | [0;m[38;5;43m20221213181912989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181912989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181912990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181912990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181912991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:14.710227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16127): Process ended prematurely: osmo-stp_10.42.42.5(pid=16127) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16127)] [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:19:14.719470 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:19:14.746197 run osmo-hlr_10.42.42.2(pid=16124): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16124)] 18:19:14.794746 run osmo-hlr_10.42.42.2(pid=16124): stdout: | (launched: 2022-12-13_18:19:11.847573) 18:19:14.845107 run osmo-hlr_10.42.42.2(pid=16124): stderr: | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181912026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181912039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181912047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181912047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181912047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:14.914820 run osmo-msc_10.42.42.6(pid=16130): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16130)] 18:19:14.963399 run osmo-msc_10.42.42.6(pid=16130): stdout: | (launched: 2022-12-13_18:19:13.814591) 18:19:15.013161 run osmo-msc_10.42.42.6(pid=16130): stderr: | [0;m[38;5;43m20221213181914089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181914089 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f685fe92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181914089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181914089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181914089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181914089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181914091 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181914092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181914092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:15.063917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16123): Terminating (SIGTERM) 18:19:15.104297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16126): Terminating (SIGTERM) 18:19:15.144569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16129): Terminating (SIGTERM) 18:19:15.184919 --- ParallelTerminationStrategy: PID 16123 died... 18:19:15.204241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16123): Terminated: ok {rc=0} 18:19:15.249042 --- ParallelTerminationStrategy: PID 16126 died... 18:19:15.268040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16126): Terminated: ok {rc=0} 18:19:15.312546 --- ParallelTerminationStrategy: PID 16129 died... 18:19:15.331853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16129): Terminated: ok {rc=0} 18:19:15.419878 bus /sierra_3: Setting Powered False 18:19:16.523809 bus /sierra_3: Setting Powered False 18:19:17.645990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:19:18.901788 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:18.909926 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:19:18.943020 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:19:18.971679 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:19:19.026067 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:19:19.059561 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:19:19.087273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:19:19.637594 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:19:19.688631 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:19.700026 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:19:19.766692 tst mo_mt_call.py: using LAC 35400 18:19:19.887957 tst mo_mt_call.py: using RAC 210 18:19:20.011534 tst mo_mt_call.py: using CellId 35400 18:19:20.134617 tst mo_mt_call.py: using BVCI 35401 18:19:20.249086 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:20.260249 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:20.271412 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:20.282511 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:20.293729 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:20.304693 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:20.428085 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:20.551361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:21.034220 run create_hlr_db(pid=16136): Launched 18:19:21.164600 bus /sierra_2: Setting Powered False 18:19:22.230177 run create_hlr_db(pid=16136): Terminated: ok {rc=0} 18:19:22.694525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16138): Launched 18:19:23.027699 run osmo-hlr_10.42.42.2(pid=16139): Launched 18:19:23.156154 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:23.730929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16141): Launched 18:19:24.065965 run osmo-stp_10.42.42.5(pid=16142): Launched 18:19:24.193524 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:24.794748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16144): Launched 18:19:25.128875 run osmo-msc_10.42.42.6(pid=16145): Launched 18:19:25.316523 run osmo-stp_10.42.42.5(pid=16142): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16142)] 18:19:25.457606 run osmo-stp_10.42.42.5(pid=16142): stdout: | (launched: 2022-12-13_18:19:24.004290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:25.599757 run osmo-stp_10.42.42.5(pid=16142): stderr: | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181924198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:25.738487 run osmo-stp_10.42.42.5(pid=16142): stdout: | (launched: 2022-12-13_18:19:24.004290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:25.870200 run osmo-stp_10.42.42.5(pid=16142): stderr: | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181924197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181924198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181924198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:26.027719 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16142): Process ended prematurely: osmo-stp_10.42.42.5(pid=16142) [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16142)] [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:19:26.037464 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:19:26.065593 run osmo-hlr_10.42.42.2(pid=16139): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16139)] 18:19:26.117189 run osmo-hlr_10.42.42.2(pid=16139): stdout: | (launched: 2022-12-13_18:19:22.966589) 18:19:26.170259 run osmo-hlr_10.42.42.2(pid=16139): stderr: | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181923167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181923179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181923187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181923188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181923188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:26.244197 run osmo-msc_10.42.42.6(pid=16145): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16145)] 18:19:26.294720 run osmo-msc_10.42.42.6(pid=16145): stdout: | (launched: 2022-12-13_18:19:25.067384) 18:19:26.347897 run osmo-msc_10.42.42.6(pid=16145): stderr: | [0;m[38;5;43m20221213181925388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181925388 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90fac09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181925388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181925388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181925388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181925389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181925390 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181925391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181925391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181925391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:26.401292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16138): Terminating (SIGTERM) 18:19:26.443743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16141): Terminating (SIGTERM) 18:19:26.486717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16144): Terminating (SIGTERM) 18:19:26.530194 --- ParallelTerminationStrategy: PID 16138 died... 18:19:26.551074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16138): Terminated: ok {rc=0} 18:19:26.598604 --- ParallelTerminationStrategy: PID 16141 died... 18:19:26.618759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16141): Terminated: ok {rc=0} 18:19:26.666219 --- ParallelTerminationStrategy: PID 16144 died... 18:19:26.686542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16144): Terminated: ok {rc=0} 18:19:26.776143 bus /sierra_3: Setting Powered False 18:19:27.876725 bus /sierra_3: Setting Powered False 18:19:28.994197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:19:30.141691 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.154111 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:19:30.221666 tst mo_mt_call_osmux.py: using LAC 35401 18:19:30.345482 tst mo_mt_call_osmux.py: using RAC 211 18:19:30.475379 tst mo_mt_call_osmux.py: using CellId 35401 18:19:30.607342 tst mo_mt_call_osmux.py: using BVCI 35402 18:19:30.729838 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.741835 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.753606 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.765316 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.777264 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:30.789217 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:30.916443 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:31.056374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:31.558418 run create_hlr_db(pid=16148): Launched 18:19:31.709626 bus /sierra_2: Setting Powered False 18:19:32.771831 run create_hlr_db(pid=16148): Terminated: ok {rc=0} 18:19:33.235553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16150): Launched 18:19:33.570928 run osmo-hlr_10.42.42.2(pid=16151): Launched 18:19:33.698781 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:34.270160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16153): Launched 18:19:34.605727 run osmo-stp_10.42.42.5(pid=16154): Launched 18:19:34.733575 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:35.334391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16156): Launched 18:19:35.670987 run osmo-msc_10.42.42.6(pid=16157): Launched 18:19:35.856512 run osmo-stp_10.42.42.5(pid=16154): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16154)] 18:19:35.997215 run osmo-stp_10.42.42.5(pid=16154): stdout: | (launched: 2022-12-13_18:19:34.543908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:36.138831 run osmo-stp_10.42.42.5(pid=16154): stderr: | [0;m[38;5;43m20221213181934737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181934738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181934738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181934738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:36.277714 run osmo-stp_10.42.42.5(pid=16154): stdout: | (launched: 2022-12-13_18:19:34.543908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:36.410103 run osmo-stp_10.42.42.5(pid=16154): stderr: | [0;m[38;5;43m20221213181934737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181934738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181934738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181934738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181934739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:36.569142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16154): Process ended prematurely: osmo-stp_10.42.42.5(pid=16154) [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16154)] [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:19:36.579058 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:19:36.607918 run osmo-hlr_10.42.42.2(pid=16151): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16151)] 18:19:36.659408 run osmo-hlr_10.42.42.2(pid=16151): stdout: | (launched: 2022-12-13_18:19:33.508559) 18:19:36.712645 run osmo-hlr_10.42.42.2(pid=16151): stderr: | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181933708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181933720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181933730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181933730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181933730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:36.786293 run osmo-msc_10.42.42.6(pid=16157): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16157)] 18:19:36.837134 run osmo-msc_10.42.42.6(pid=16157): stdout: | (launched: 2022-12-13_18:19:35.608728) 18:19:36.890075 run osmo-msc_10.42.42.6(pid=16157): stderr: | [0;m[38;5;43m20221213181935932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181935933 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb543cbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181935933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181935933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181935933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181935933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181935935 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181935935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181935935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181935935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:36.943107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16150): Terminating (SIGTERM) 18:19:36.985578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16153): Terminating (SIGTERM) 18:19:37.028767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16156): Terminating (SIGTERM) 18:19:37.071912 --- ParallelTerminationStrategy: PID 16150 died... 18:19:37.092911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16150): Terminated: ok {rc=0} 18:19:37.140400 --- ParallelTerminationStrategy: PID 16153 died... 18:19:37.160846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16153): Terminated: ok {rc=0} 18:19:37.207741 --- ParallelTerminationStrategy: PID 16156 died... 18:19:37.227989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16156): Terminated: ok {rc=0} 18:19:37.318162 bus /sierra_3: Setting Powered False 18:19:38.421469 bus /sierra_3: Setting Powered False 18:19:39.538106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:19:40.788755 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:40.796040 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:19:40.828136 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:19:40.854875 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:19:40.907852 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:19:40.939993 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:19:40.966419 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:19:41.517935 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:19:41.568001 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:41.579982 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:19:41.630341 tst mo_mt_call.py: using LAC 35402 18:19:41.761267 tst mo_mt_call.py: using RAC 212 18:19:41.892777 tst mo_mt_call.py: using CellId 35402 18:19:42.024580 tst mo_mt_call.py: using BVCI 35403 18:19:42.147371 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:42.159415 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:42.171269 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:42.183146 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:42.195409 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:42.207636 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:42.328936 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:42.451476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:42.934081 run create_hlr_db(pid=16162): Launched 18:19:43.067681 bus /sierra_2: Setting Powered False 18:19:44.134190 run create_hlr_db(pid=16162): Terminated: ok {rc=0} 18:19:44.598079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Launched 18:19:44.931523 run osmo-hlr_10.42.42.2(pid=16165): Launched 18:19:45.060052 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:45.633367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Launched 18:19:45.981491 run osmo-stp_10.42.42.5(pid=16168): Launched 18:19:46.148877 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:46.858147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16170): Launched 18:19:47.197776 run osmo-msc_10.42.42.6(pid=16171): Launched 18:19:47.450526 run osmo-stp_10.42.42.5(pid=16168): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] 18:19:47.590994 run osmo-stp_10.42.42.5(pid=16168): stdout: | (launched: 2022-12-13_18:19:45.919619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:47.732128 run osmo-stp_10.42.42.5(pid=16168): stderr: | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181946287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:47.871319 run osmo-stp_10.42.42.5(pid=16168): stdout: | (launched: 2022-12-13_18:19:45.919619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:48.003768 run osmo-stp_10.42.42.5(pid=16168): stderr: | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181946276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181946287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181946288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:48.163005 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16168): Process ended prematurely: osmo-stp_10.42.42.5(pid=16168) [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:19:48.172592 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:19:48.201229 run osmo-hlr_10.42.42.2(pid=16165): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16165)] 18:19:48.253202 run osmo-hlr_10.42.42.2(pid=16165): stdout: | (launched: 2022-12-13_18:19:44.870078) 18:19:48.306811 run osmo-hlr_10.42.42.2(pid=16165): stderr: | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181945068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181945080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181945088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181945089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181945089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:48.381173 run osmo-msc_10.42.42.6(pid=16171): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16171)] 18:19:48.432306 run osmo-msc_10.42.42.6(pid=16171): stdout: | (launched: 2022-12-13_18:19:47.131476) 18:19:48.485990 run osmo-msc_10.42.42.6(pid=16171): stderr: | [0;m[38;5;43m20221213181947497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181947497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f7b617c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181947497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181947497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181947497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181947498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181947499 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181947500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181947500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181947500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:48.540177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Terminating (SIGTERM) 18:19:48.583236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Terminating (SIGTERM) 18:19:48.626511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16170): Terminating (SIGTERM) 18:19:48.670072 --- ParallelTerminationStrategy: PID 16164 died... 18:19:48.691143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Terminated: ok {rc=0} 18:19:48.738975 --- ParallelTerminationStrategy: PID 16167 died... 18:19:48.759466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Terminated: ok {rc=0} 18:19:48.807129 --- ParallelTerminationStrategy: PID 16170 died... 18:19:48.827695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16170): Terminated: ok {rc=0} 18:19:48.919295 bus /sierra_3: Setting Powered False 18:19:50.020228 bus /sierra_3: Setting Powered False 18:19:51.138570 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:19:52.290582 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.303453 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:19:52.355650 tst mo_mt_call_osmux.py: using LAC 35403 18:19:52.487372 tst mo_mt_call_osmux.py: using RAC 213 18:19:52.619678 tst mo_mt_call_osmux.py: using CellId 35403 18:19:52.754297 tst mo_mt_call_osmux.py: using BVCI 35404 18:19:52.876241 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.888232 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.899982 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.911674 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.923784 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:52.935853 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:53.057892 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:53.183862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:53.698623 run create_hlr_db(pid=16173): Launched 18:19:53.825807 bus /sierra_2: Setting Powered False 18:19:54.891303 run create_hlr_db(pid=16173): Terminated: ok {rc=0} 18:19:55.338757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16175): Launched 18:19:55.654905 run osmo-hlr_10.42.42.2(pid=16176): Launched 18:19:55.778070 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:56.331103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16178): Launched 18:19:56.645936 run osmo-stp_10.42.42.5(pid=16179): Launched 18:19:56.768911 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:57.335088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16181): Launched 18:19:57.649764 run osmo-msc_10.42.42.6(pid=16182): Launched 18:19:57.827466 run osmo-stp_10.42.42.5(pid=16179): ERR: Terminated: ERROR {rc=1} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16179)] 18:19:57.959349 run osmo-stp_10.42.42.5(pid=16179): stdout: | (launched: 2022-12-13_18:19:56.587408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:58.090886 run osmo-stp_10.42.42.5(pid=16179): stderr: | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181956760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:58.220540 run osmo-stp_10.42.42.5(pid=16179): stdout: | (launched: 2022-12-13_18:19:56.587408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:58.344454 run osmo-stp_10.42.42.5(pid=16179): stderr: | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213181956759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213181956760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213181956760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:58.492757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16179): Process ended prematurely: osmo-stp_10.42.42.5(pid=16179) [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16179)] [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:19:58.502091 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:19:58.529291 run osmo-hlr_10.42.42.2(pid=16176): ERR: Terminated: ERROR {rc=237} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16176)] 18:19:58.577435 run osmo-hlr_10.42.42.2(pid=16176): stdout: | (launched: 2022-12-13_18:19:55.596498) 18:19:58.627521 run osmo-hlr_10.42.42.2(pid=16176): stderr: | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213181955774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213181955786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213181955794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213181955794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213181955794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:58.697184 run osmo-msc_10.42.42.6(pid=16182): ERR: Terminated: ERROR {rc=2} [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16182)] 18:19:58.745287 run osmo-msc_10.42.42.6(pid=16182): stdout: | (launched: 2022-12-13_18:19:57.591085) 18:19:58.794860 run osmo-msc_10.42.42.6(pid=16182): stderr: | [0;m[38;5;43m20221213181957864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213181957864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc13d6e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213181957864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213181957864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213181957864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213181957864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213181957866 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213181957866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213181957867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213181957867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:58.845102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16175): Terminating (SIGTERM) 18:19:58.885146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16178): Terminating (SIGTERM) 18:19:58.925526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16181): Terminating (SIGTERM) 18:19:58.966247 --- ParallelTerminationStrategy: PID 16175 died... 18:19:58.985991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16175): Terminated: ok {rc=0} 18:19:59.030878 --- ParallelTerminationStrategy: PID 16178 died... 18:19:59.050092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16178): Terminated: ok {rc=0} 18:19:59.095139 --- ParallelTerminationStrategy: PID 16181 died... 18:19:59.114454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16181): Terminated: ok {rc=0} 18:19:59.204472 bus /sierra_3: Setting Powered False 18:20:00.305155 bus /sierra_3: Setting Powered False 18:20:01.421952 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 emergency:nanobts+band-900 --------------------------------------------------------------------- 18:20:02.691096 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:20:02.696358 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:20:02.728344 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:20:02.754996 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:20:02.838762 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:20:02.870515 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:20:02.896520 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:20:03.483164 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2392 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 18:20:03.488830 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:03.500390 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:03.547099 tst emergency_mo_mt_call.py: using LAC 35404 18:20:03.665575 tst emergency_mo_mt_call.py: using RAC 214 18:20:03.785949 tst emergency_mo_mt_call.py: using CellId 35404 18:20:03.902477 tst emergency_mo_mt_call.py: using BVCI 35405 18:20:04.014079 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:04.024864 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:04.035499 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:04.046085 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:04.056525 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:04.067471 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:04.188144 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:04.306056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:04.778597 run create_hlr_db(pid=16190): Launched 18:20:04.905183 bus /sierra_2: Setting Powered False 18:20:05.965929 run create_hlr_db(pid=16190): Terminated: ok {rc=0} 18:20:06.411860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16192): Launched 18:20:06.741547 run osmo-hlr_10.42.42.2(pid=16193): Launched 18:20:06.867620 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:07.430341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16195): Launched 18:20:07.758087 run osmo-stp_10.42.42.5(pid=16196): Launched 18:20:07.893402 tst emergency_mo_mt_call.py: using MSISDN 8261 18:20:08.062606 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:08.649524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16198): Launched 18:20:08.977602 run osmo-msc_10.42.42.6(pid=16199): Launched 18:20:09.159736 run osmo-stp_10.42.42.5(pid=16196): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16196)] 18:20:09.297889 run osmo-stp_10.42.42.5(pid=16196): stdout: | (launched: 2022-12-13_18:20:07.697747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:09.437707 run osmo-stp_10.42.42.5(pid=16196): stderr: | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182007892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182007892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182007892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:09.574701 run osmo-stp_10.42.42.5(pid=16196): stdout: | (launched: 2022-12-13_18:20:07.697747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:09.704862 run osmo-stp_10.42.42.5(pid=16196): stderr: | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182007892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182007892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182007892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:09.860719 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16196): Process ended prematurely: osmo-stp_10.42.42.5(pid=16196) [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16196)] [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 18:20:09.870185 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 18:20:09.898102 run osmo-hlr_10.42.42.2(pid=16193): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16193)] 18:20:09.949695 run osmo-hlr_10.42.42.2(pid=16193): stdout: | (launched: 2022-12-13_18:20:06.680940) 18:20:10.002334 run osmo-hlr_10.42.42.2(pid=16193): stderr: | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182006877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182006889 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182006899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182006899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182006899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:10.075665 run osmo-msc_10.42.42.6(pid=16199): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16199)] 18:20:10.126191 run osmo-msc_10.42.42.6(pid=16199): stdout: | (launched: 2022-12-13_18:20:08.916627) 18:20:10.178655 run osmo-msc_10.42.42.6(pid=16199): stderr: | [0;m[38;5;43m20221213182009236 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182009237 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb97d603c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182009237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182009237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182009237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182009237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182009239 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182009239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182009240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182009240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:10.231736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16192): Terminating (SIGTERM) 18:20:10.273873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16195): Terminating (SIGTERM) 18:20:10.317010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16198): Terminating (SIGTERM) 18:20:10.359742 --- ParallelTerminationStrategy: PID 16192 died... 18:20:10.380404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16192): Terminated: ok {rc=0} 18:20:10.427453 --- ParallelTerminationStrategy: PID 16195 died... 18:20:10.447589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16195): Terminated: ok {rc=0} 18:20:10.494557 --- ParallelTerminationStrategy: PID 16198 died... 18:20:10.514728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16198): Terminated: ok {rc=0} 18:20:10.604506 bus /sierra_3: Setting Powered False 18:20:11.704825 bus /sierra_3: Setting Powered False 18:20:12.820820 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 18:20:13.908435 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:13.920544 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:13.971819 tst emergency_preemptive_call.py: using LAC 35405 18:20:14.105756 tst emergency_preemptive_call.py: using RAC 215 18:20:14.233227 tst emergency_preemptive_call.py: using CellId 35405 18:20:14.358104 tst emergency_preemptive_call.py: using BVCI 35406 18:20:14.476542 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:14.487981 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:14.499092 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:14.510319 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:14.521717 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:20:14.533502 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:14.655631 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:14.774007 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:14.895542 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:15.016933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:15.524309 run create_hlr_db(pid=16201): Launched 18:20:15.650792 bus /sierra_2: Setting Powered False 18:20:16.715953 run create_hlr_db(pid=16201): Terminated: ok {rc=0} 18:20:17.251974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16203): Launched 18:20:17.572335 run osmo-hlr_10.42.42.2(pid=16204): Launched 18:20:17.691619 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:18.219034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16206): Launched 18:20:18.526939 run osmo-stp_10.42.42.5(pid=16207): Launched 18:20:18.653096 tst emergency_preemptive_call.py: using MSISDN 8262 18:20:18.809723 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:19.362048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16209): Launched 18:20:19.674053 run osmo-msc_10.42.42.6(pid=16210): Launched 18:20:19.847811 run osmo-stp_10.42.42.5(pid=16207): ERR: Terminated: ERROR {rc=1} [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16207)] 18:20:19.977914 run osmo-stp_10.42.42.5(pid=16207): stdout: | (launched: 2022-12-13_18:20:18.469398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:20.107371 run osmo-stp_10.42.42.5(pid=16207): stderr: | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182018640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:20.234734 run osmo-stp_10.42.42.5(pid=16207): stdout: | (launched: 2022-12-13_18:20:18.469398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:20.356736 run osmo-stp_10.42.42.5(pid=16207): stderr: | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182018639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182018640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182018640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:20.502915 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16207): Process ended prematurely: osmo-stp_10.42.42.5(pid=16207) [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16207)] [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 18:20:20.511310 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:20:20.537939 run osmo-hlr_10.42.42.2(pid=16204): ERR: Terminated: ERROR {rc=237} [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16204)] 18:20:20.586474 run osmo-hlr_10.42.42.2(pid=16204): stdout: | (launched: 2022-12-13_18:20:17.515162) 18:20:20.636697 run osmo-hlr_10.42.42.2(pid=16204): stderr: | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182017692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182017708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182017719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182017719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182017719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:20.707124 run osmo-msc_10.42.42.6(pid=16210): ERR: Terminated: ERROR {rc=2} [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16210)] 18:20:20.755457 run osmo-msc_10.42.42.6(pid=16210): stdout: | (launched: 2022-12-13_18:20:19.614685) 18:20:20.805458 run osmo-msc_10.42.42.6(pid=16210): stderr: | [0;m[38;5;43m20221213182019891 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182019891 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb27aea1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182019891 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182019891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182019891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182019891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182019893 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182019894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182019894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182019894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:20.855764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16203): Terminating (SIGTERM) 18:20:20.896135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16206): Terminating (SIGTERM) 18:20:20.936702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16209): Terminating (SIGTERM) 18:20:20.977511 --- ParallelTerminationStrategy: PID 16203 died... 18:20:20.997121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16203): Terminated: ok {rc=0} 18:20:21.042016 --- ParallelTerminationStrategy: PID 16206 died... 18:20:21.061073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16206): Terminated: ok {rc=0} 18:20:21.105629 --- ParallelTerminationStrategy: PID 16209 died... 18:20:21.124424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16209): Terminated: ok {rc=0} 18:20:21.210274 bus /sierra_9: Setting Powered False 18:20:22.309833 bus /sierra_9: Setting Powered False 18:20:23.431662 bus /sierra_8: Setting Powered False 18:20:24.531461 bus /sierra_8: Setting Powered False 18:20:25.646778 bus /sierra_3: Setting Powered False 18:20:26.745552 bus /sierra_3: Setting Powered False 18:20:27.864404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900 --------------------------------------------------------------------- 18:20:29.146408 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:20:29.152031 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:20:29.185217 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 18:20:29.225391 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:20:29.315385 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:20:29.348495 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 18:20:29.387854 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:20:29.980765 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 18:20:30.033427 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.044304 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:30.099271 tst cs_paging_gprs_active.py: using LAC 35406 18:20:30.233302 tst cs_paging_gprs_active.py: using RAC 216 18:20:30.357452 tst cs_paging_gprs_active.py: using CellId 35406 18:20:30.479738 tst cs_paging_gprs_active.py: using BVCI 35407 18:20:30.604540 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.615967 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.627508 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.638781 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.650734 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.662795 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.675317 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.687299 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:30.699451 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:30.821354 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:30.957204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:20:31.171536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:31.493214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16216): Launched 18:20:31.788430 run iperf3-srv_10.42.42.10(pid=16217): Launched 18:20:31.967886 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:20:32.206258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:32.523559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16218): Launched 18:20:32.798814 run iperf3-srv_10.42.42.10(pid=16219): Launched 18:20:32.917968 tst cs_paging_gprs_active.py:38: start network... 18:20:33.126405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:33.608594 run create_hlr_db(pid=16220): Launched 18:20:33.738183 bus /sierra_2: Setting Powered False 18:20:34.800476 run create_hlr_db(pid=16220): Terminated: ok {rc=0} 18:20:35.256327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Launched 18:20:35.592807 run osmo-hlr_10.42.42.2(pid=16223): Launched 18:20:35.722931 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:36.295807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Launched 18:20:36.632277 run osmo-stp_10.42.42.5(pid=16226): Launched 18:20:36.760419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:37.333510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16228): Launched 18:20:37.463698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:37.747507 run patchelf(pid=16229): Launched 18:20:37.932820 run osmo-stp_10.42.42.5(pid=16226): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] 18:20:38.074240 run osmo-stp_10.42.42.5(pid=16226): stdout: | (launched: 2022-12-13_18:20:36.570648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:38.217026 run osmo-stp_10.42.42.5(pid=16226): stderr: | [0;m[38;5;43m20221213182036765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182036765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182036766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182036766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182036766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182036766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182036767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:38.359683 run osmo-stp_10.42.42.5(pid=16226): stdout: | (launched: 2022-12-13_18:20:36.570648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:38.495651 run osmo-stp_10.42.42.5(pid=16226): stderr: | [0;m[38;5;43m20221213182036765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182036765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182036766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182036766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182036766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182036766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182036767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:38.657298 run patchelf(pid=16229): Terminating (SIGINT) 18:20:38.845569 run patchelf(pid=16229): Terminated: ok {rc=0} 18:20:38.981353 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16226): Process ended prematurely: osmo-stp_10.42.42.5(pid=16226) [trial-2392↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] [trial-2392↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 18:20:38.991826 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:20:39.020709 run osmo-hlr_10.42.42.2(pid=16223): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16223)] 18:20:39.072284 run osmo-hlr_10.42.42.2(pid=16223): stdout: | (launched: 2022-12-13_18:20:35.530835) 18:20:39.125373 run osmo-hlr_10.42.42.2(pid=16223): stderr: | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182035732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182035750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182035760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182035760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182035760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:39.178661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16216): Terminating (SIGTERM) 18:20:39.220862 run iperf3-srv_10.42.42.10(pid=16217): Terminating (SIGTERM) 18:20:39.263565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16218): Terminating (SIGTERM) 18:20:39.306278 run iperf3-srv_10.42.42.10(pid=16219): Terminating (SIGTERM) 18:20:39.348670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Terminating (SIGTERM) 18:20:39.391176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Terminating (SIGTERM) 18:20:39.433773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16228): Terminating (SIGTERM) 18:20:39.476649 --- ParallelTerminationStrategy: PID 16216 died... 18:20:39.497413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16216): Terminated: ok {rc=0} 18:20:39.544773 --- ParallelTerminationStrategy: PID 16217 died... 18:20:39.564762 run iperf3-srv_10.42.42.10(pid=16217): Terminated {rc=256} 18:20:39.611487 --- ParallelTerminationStrategy: PID 16218 died... 18:20:39.631522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16218): Terminated: ok {rc=0} 18:20:39.678343 --- ParallelTerminationStrategy: PID 16219 died... 18:20:39.698415 run iperf3-srv_10.42.42.10(pid=16219): Terminated {rc=256} 18:20:39.745119 --- ParallelTerminationStrategy: PID 16222 died... 18:20:39.765214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Terminated: ok {rc=0} 18:20:39.812014 --- ParallelTerminationStrategy: PID 16225 died... 18:20:39.831989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Terminated: ok {rc=0} 18:20:39.878693 --- ParallelTerminationStrategy: PID 16228 died... 18:20:39.898825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16228): Terminated: ok {rc=0} 18:20:39.988210 bus /gobi_0: Setting Powered False 18:20:41.087885 bus /gobi_0: Setting Powered False 18:20:42.207021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 18:20:43.355801 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.367330 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:43.418282 tst iperf3.py: using LAC 35407 18:20:43.543703 tst iperf3.py: using RAC 217 18:20:43.667514 tst iperf3.py: using CellId 35407 18:20:43.791432 tst iperf3.py: using BVCI 35408 18:20:43.906007 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.916767 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.927362 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.937905 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.948258 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.959357 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.970342 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.980909 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:43.991668 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:44.114799 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:20:44.340349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:44.675905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16230): Launched 18:20:44.967387 run iperf3-srv_10.42.42.10(pid=16231): Launched 18:20:45.094376 tst iperf3.py:8: start network... 18:20:45.319204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:45.843130 run create_hlr_db(pid=16232): Launched 18:20:45.999319 bus /gobi_6: Setting Powered False 18:20:47.075901 run create_hlr_db(pid=16232): Terminated: ok {rc=0} 18:20:47.558509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Launched 18:20:47.875025 run osmo-hlr_10.42.42.2(pid=16235): Launched 18:20:47.995471 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:48.549650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Launched 18:20:48.865297 run osmo-stp_10.42.42.5(pid=16238): Launched 18:20:48.985865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:49.521408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Launched 18:20:49.642307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:49.905718 run patchelf(pid=16241): Launched 18:20:50.080062 run osmo-stp_10.42.42.5(pid=16238): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] 18:20:50.213429 run osmo-stp_10.42.42.5(pid=16238): stdout: | (launched: 2022-12-13_18:20:48.806887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:50.347315 run osmo-stp_10.42.42.5(pid=16238): stderr: | [0;m[38;5;43m20221213182048977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182048977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182048978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182048978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182048978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182048979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182048979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:50.481778 run osmo-stp_10.42.42.5(pid=16238): stdout: | (launched: 2022-12-13_18:20:48.806887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:50.609618 run osmo-stp_10.42.42.5(pid=16238): stderr: | [0;m[38;5;43m20221213182048977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182048977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182048978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182048978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182048978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182048979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182048979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:50.760822 run patchelf(pid=16241): Terminating (SIGINT) 18:20:50.939109 run patchelf(pid=16241): Terminated: ok {rc=0} 18:20:51.067137 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16238): Process ended prematurely: osmo-stp_10.42.42.5(pid=16238) [trial-2392↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] [trial-2392↪gprs:nanobts+band-900↪iperf3.py:8] 18:20:51.076682 tst iperf3.py:8: Test FAILED (7.8 sec) 18:20:51.104089 run osmo-hlr_10.42.42.2(pid=16235): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16235)] 18:20:51.152121 run osmo-hlr_10.42.42.2(pid=16235): stdout: | (launched: 2022-12-13_18:20:47.816676) 18:20:51.201866 run osmo-hlr_10.42.42.2(pid=16235): stderr: | [0;m[1;31m20221213182047993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182047994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182047994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182047994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182047994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182047994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182048006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182048014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182048014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182048014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:51.251959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16230): Terminating (SIGTERM) 18:20:51.292083 run iperf3-srv_10.42.42.10(pid=16231): Terminating (SIGTERM) 18:20:51.332025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Terminating (SIGTERM) 18:20:51.372217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Terminating (SIGTERM) 18:20:51.412332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Terminating (SIGTERM) 18:20:51.452742 --- ParallelTerminationStrategy: PID 16230 died... 18:20:51.472333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16230): Terminated: ok {rc=0} 18:20:51.516803 --- ParallelTerminationStrategy: PID 16231 died... 18:20:51.535934 run iperf3-srv_10.42.42.10(pid=16231): Terminated {rc=256} 18:20:51.580119 --- ParallelTerminationStrategy: PID 16234 died... 18:20:51.599124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Terminated: ok {rc=0} 18:20:51.643349 --- ParallelTerminationStrategy: PID 16237 died... 18:20:51.662359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Terminated: ok {rc=0} 18:20:51.706481 --- ParallelTerminationStrategy: PID 16240 died... 18:20:51.725471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Terminated: ok {rc=0} 18:20:51.812245 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 18:20:52.967142 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:52.979024 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:53.029440 tst iperf3m4.py: using LAC 35408 18:20:53.152681 tst iperf3m4.py: using RAC 218 18:20:53.277080 tst iperf3m4.py: using CellId 35408 18:20:53.400882 tst iperf3m4.py: using BVCI 35409 18:20:53.514223 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.525217 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.535870 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.546684 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.557358 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.567808 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.579121 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.590386 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:53.601400 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:53.724138 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:53.844340 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:53.966264 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:54.089178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:20:54.314579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:54.651126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16243): Launched 18:20:54.942993 run iperf3-srv_10.42.42.10(pid=16244): Launched 18:20:55.068423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:20:55.292769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:55.629072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16245): Launched 18:20:55.921714 run iperf3-srv_10.42.42.10(pid=16246): Launched 18:20:56.047599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:20:56.273283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:56.610274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16247): Launched 18:20:56.903087 run iperf3-srv_10.42.42.10(pid=16248): Launched 18:20:57.029076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:20:57.253230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:57.588289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16249): Launched 18:20:57.880854 run iperf3-srv_10.42.42.10(pid=16250): Launched 18:20:58.007798 tst iperf3m4.py:8: start network... 18:20:58.232930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:58.750287 run create_hlr_db(pid=16251): Launched 18:20:58.877830 bus /gobi_6: Setting Powered False 18:20:59.943856 run create_hlr_db(pid=16251): Terminated: ok {rc=0} 18:21:00.391240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Launched 18:21:00.707242 run osmo-hlr_10.42.42.2(pid=16254): Launched 18:21:00.828629 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:01.506420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Launched 18:21:01.915043 run osmo-stp_10.42.42.5(pid=16257): Launched 18:21:02.052890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:02.767318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16259): Launched 18:21:02.889228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:03.154093 run patchelf(pid=16260): Launched 18:21:03.328797 run osmo-stp_10.42.42.5(pid=16257): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] 18:21:03.461880 run osmo-stp_10.42.42.5(pid=16257): stdout: | (launched: 2022-12-13_18:21:01.851452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:03.596806 run osmo-stp_10.42.42.5(pid=16257): stderr: | [0;m[38;5;43m20221213182102217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182102217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182102218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182102218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182102218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182102219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182102219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:03.731514 run osmo-stp_10.42.42.5(pid=16257): stdout: | (launched: 2022-12-13_18:21:01.851452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:03.859585 run osmo-stp_10.42.42.5(pid=16257): stderr: | [0;m[38;5;43m20221213182102217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182102217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182102218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182102218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182102218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182102219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182102219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:04.011394 run patchelf(pid=16260): Terminating (SIGINT) 18:21:04.190005 run patchelf(pid=16260): Terminated: ok {rc=0} 18:21:04.319020 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16257): Process ended prematurely: osmo-stp_10.42.42.5(pid=16257) [trial-2392↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] [trial-2392↪gprs:nanobts+band-900↪iperf3m4.py:8] 18:21:04.329054 tst iperf3m4.py:8: Test FAILED (11.4 sec) 18:21:04.357209 run osmo-hlr_10.42.42.2(pid=16254): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16254)] 18:21:04.405737 run osmo-hlr_10.42.42.2(pid=16254): stdout: | (launched: 2022-12-13_18:21:00.648756) 18:21:04.455777 run osmo-hlr_10.42.42.2(pid=16254): stderr: | [0;m[1;31m20221213182100835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182100835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182100835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182100835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182100835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182100836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182100864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182100880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182100880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182100880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:04.506226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16243): Terminating (SIGTERM) 18:21:04.546581 run iperf3-srv_10.42.42.10(pid=16244): Terminating (SIGTERM) 18:21:04.587107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16245): Terminating (SIGTERM) 18:21:04.627489 run iperf3-srv_10.42.42.10(pid=16246): Terminating (SIGTERM) 18:21:04.667672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16247): Terminating (SIGTERM) 18:21:04.707925 run iperf3-srv_10.42.42.10(pid=16248): Terminating (SIGTERM) 18:21:04.748080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16249): Terminating (SIGTERM) 18:21:04.788335 run iperf3-srv_10.42.42.10(pid=16250): Terminating (SIGTERM) 18:21:04.828595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Terminating (SIGTERM) 18:21:04.869043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Terminating (SIGTERM) 18:21:04.909174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16259): Terminating (SIGTERM) 18:21:04.949636 --- ParallelTerminationStrategy: PID 16243 died... 18:21:04.969368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16243): Terminated: ok {rc=0} 18:21:05.014360 --- ParallelTerminationStrategy: PID 16244 died... 18:21:05.033619 run iperf3-srv_10.42.42.10(pid=16244): Terminated {rc=256} 18:21:05.078267 --- ParallelTerminationStrategy: PID 16245 died... 18:21:05.097667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16245): Terminated: ok {rc=0} 18:21:05.142205 --- ParallelTerminationStrategy: PID 16246 died... 18:21:05.161270 run iperf3-srv_10.42.42.10(pid=16246): Terminated {rc=256} 18:21:05.205980 --- ParallelTerminationStrategy: PID 16247 died... 18:21:05.225189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16247): Terminated: ok {rc=0} 18:21:05.269672 --- ParallelTerminationStrategy: PID 16248 died... 18:21:05.288726 run iperf3-srv_10.42.42.10(pid=16248): Terminated {rc=256} 18:21:05.333284 --- ParallelTerminationStrategy: PID 16249 died... 18:21:05.352308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16249): Terminated: ok {rc=0} 18:21:05.396816 --- ParallelTerminationStrategy: PID 16250 died... 18:21:05.415962 run iperf3-srv_10.42.42.10(pid=16250): Terminated {rc=256} 18:21:05.460163 --- ParallelTerminationStrategy: PID 16253 died... 18:21:05.479309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Terminated: ok {rc=0} 18:21:05.523890 --- ParallelTerminationStrategy: PID 16256 died... 18:21:05.542962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Terminated: ok {rc=0} 18:21:05.587420 --- ParallelTerminationStrategy: PID 16259 died... 18:21:05.606635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16259): Terminated: ok {rc=0} 18:21:05.694297 bus /gobi_4: Setting Powered False 18:21:06.795664 bus /gobi_4: Setting Powered False 18:21:07.912220 bus /gobi_1: Setting Powered False 18:21:09.013492 bus /gobi_1: Setting Powered False 18:21:10.133169 bus /gobi_0: Setting Powered False 18:21:11.232635 bus /gobi_0: Setting Powered False 18:21:12.355520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900 ping.py ---------------------------------------------- 18:21:13.460267 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:13.471702 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:21:13.519270 tst ping.py: using LAC 35409 18:21:13.641439 tst ping.py: using RAC 219 18:21:13.761072 tst ping.py: using CellId 35409 18:21:13.881189 tst ping.py: using BVCI 35410 18:21:13.991321 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.002150 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.012604 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.023112 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.033510 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.043914 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.054662 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:14.065149 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:21:14.182104 tst ping.py:19: start network... 18:21:14.388054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:14.859982 run create_hlr_db(pid=16261): Launched 18:21:14.986742 bus /gobi_6: Setting Powered False 18:21:16.073910 run create_hlr_db(pid=16261): Terminated: ok {rc=0} 18:21:16.565959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16263): Launched 18:21:16.909851 run osmo-hlr_10.42.42.2(pid=16264): Launched 18:21:17.167670 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:17.741096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16266): Launched 18:21:18.069349 run osmo-stp_10.42.42.5(pid=16267): Launched 18:21:18.194609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:18.758412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16269): Launched 18:21:18.885460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:19.162812 run patchelf(pid=16270): Launched 18:21:19.344500 run osmo-stp_10.42.42.5(pid=16267): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16267)] 18:21:19.482911 run osmo-stp_10.42.42.5(pid=16267): stdout: | (launched: 2022-12-13_18:21:18.008738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:19.623955 run osmo-stp_10.42.42.5(pid=16267): stderr: | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182118200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:19.764331 run osmo-stp_10.42.42.5(pid=16267): stdout: | (launched: 2022-12-13_18:21:18.008738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:19.898152 run osmo-stp_10.42.42.5(pid=16267): stderr: | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182118200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182118200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182118201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:20.057248 run patchelf(pid=16270): Terminating (SIGINT) 18:21:20.242668 run patchelf(pid=16270): Terminated: ok {rc=0} 18:21:20.375703 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16267): Process ended prematurely: osmo-stp_10.42.42.5(pid=16267) [trial-2392↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16267)] [trial-2392↪gprs:nanobts+band-900↪ping.py:22] 18:21:20.385332 tst ping.py:22: Test FAILED (6.9 sec) 18:21:20.414003 run osmo-hlr_10.42.42.2(pid=16264): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16264)] 18:21:20.465853 run osmo-hlr_10.42.42.2(pid=16264): stdout: | (launched: 2022-12-13_18:21:16.846655) 18:21:20.518633 run osmo-hlr_10.42.42.2(pid=16264): stderr: | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182117136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182117156 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182117164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182117164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182117164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:20.571952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16263): Terminating (SIGTERM) 18:21:20.614296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16266): Terminating (SIGTERM) 18:21:20.656808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16269): Terminating (SIGTERM) 18:21:20.700198 --- ParallelTerminationStrategy: PID 16263 died... 18:21:20.721026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16263): Terminated: ok {rc=0} 18:21:20.768516 --- ParallelTerminationStrategy: PID 16266 died... 18:21:20.789081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16266): Terminated: ok {rc=0} 18:21:20.836239 --- ParallelTerminationStrategy: PID 16269 died... 18:21:20.856562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16269): Terminated: ok {rc=0} 18:21:20.946827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 18:21:22.035764 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.047866 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:21:22.098730 tst ping_idle_ping.py: using LAC 35410 18:21:22.220901 tst ping_idle_ping.py: using RAC 220 18:21:22.340822 tst ping_idle_ping.py: using CellId 35410 18:21:22.462679 tst ping_idle_ping.py: using BVCI 35411 18:21:22.575759 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.586700 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.597976 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.608525 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.619004 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.629505 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.640068 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:21:22.650733 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:21:22.774231 tst ping_idle_ping.py:24: start network... 18:21:22.996666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:23.507374 run create_hlr_db(pid=16271): Launched 18:21:23.635588 bus /gobi_6: Setting Powered False 18:21:24.700595 run create_hlr_db(pid=16271): Terminated: ok {rc=0} 18:21:25.140401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16273): Launched 18:21:25.450084 run osmo-hlr_10.42.42.2(pid=16274): Launched 18:21:25.568772 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:26.096637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16276): Launched 18:21:26.406627 run osmo-stp_10.42.42.5(pid=16277): Launched 18:21:26.527281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:27.057396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16279): Launched 18:21:27.175558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:27.435226 run patchelf(pid=16280): Launched 18:21:27.608135 run osmo-stp_10.42.42.5(pid=16277): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16277)] 18:21:27.737500 run osmo-stp_10.42.42.5(pid=16277): stdout: | (launched: 2022-12-13_18:21:26.349183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:27.868908 run osmo-stp_10.42.42.5(pid=16277): stderr: | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182126519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:28.000589 run osmo-stp_10.42.42.5(pid=16277): stdout: | (launched: 2022-12-13_18:21:26.349183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:28.125356 run osmo-stp_10.42.42.5(pid=16277): stderr: | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182126518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182126519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182126519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:28.273397 run patchelf(pid=16280): Terminating (SIGINT) 18:21:28.447814 run patchelf(pid=16280): Terminated: ok {rc=0} 18:21:28.573128 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16277): Process ended prematurely: osmo-stp_10.42.42.5(pid=16277) [trial-2392↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16277)] [trial-2392↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 18:21:28.581950 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:21:28.609266 run osmo-hlr_10.42.42.2(pid=16274): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16274)] 18:21:28.657605 run osmo-hlr_10.42.42.2(pid=16274): stdout: | (launched: 2022-12-13_18:21:25.392639) 18:21:28.707762 run osmo-hlr_10.42.42.2(pid=16274): stderr: | [0;m[1;31m20221213182125569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182125570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182125570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182125570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182125570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182125570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182125582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182125590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182125590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182125590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:28.758283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16273): Terminating (SIGTERM) 18:21:28.798794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16276): Terminating (SIGTERM) 18:21:28.839292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16279): Terminating (SIGTERM) 18:21:28.880035 --- ParallelTerminationStrategy: PID 16273 died... 18:21:28.899270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16273): Terminated: ok {rc=0} 18:21:28.944021 --- ParallelTerminationStrategy: PID 16276 died... 18:21:28.963027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16276): Terminated: ok {rc=0} 18:21:29.007669 --- ParallelTerminationStrategy: PID 16279 died... 18:21:29.026775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16279): Terminated: ok {rc=0} 18:21:29.112449 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 18:21:30.419531 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:21:30.426838 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:21:30.461243 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:21:30.501187 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:21:30.590512 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:21:30.623974 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:21:30.663870 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:21:31.300903 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:21:31.359843 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:31.371837 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:31.421346 tst cs_paging_gprs_active.py: using LAC 35411 18:21:31.550454 tst cs_paging_gprs_active.py: using RAC 221 18:21:31.706392 tst cs_paging_gprs_active.py: using CellId 35411 18:21:31.834979 tst cs_paging_gprs_active.py: using BVCI 35412 18:21:31.952141 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:31.963998 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:31.975903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:31.987428 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:31.999002 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.010714 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.022431 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.034327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.045956 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:32.169098 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:32.290824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:21:32.502898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:32.819735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16284): Launched 18:21:33.096719 run iperf3-srv_10.42.42.10(pid=16285): Launched 18:21:33.216165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:21:33.426472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:33.742398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Launched 18:21:34.019630 run iperf3-srv_10.42.42.10(pid=16287): Launched 18:21:34.137695 tst cs_paging_gprs_active.py:38: start network... 18:21:34.347241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:34.831623 run create_hlr_db(pid=16288): Launched 18:21:34.959182 bus /gobi_6: Setting Powered False 18:21:36.021428 run create_hlr_db(pid=16288): Terminated: ok {rc=0} 18:21:36.456139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16290): Launched 18:21:36.773590 run osmo-hlr_10.42.42.2(pid=16291): Launched 18:21:36.894375 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:37.445296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16293): Launched 18:21:37.758146 run osmo-stp_10.42.42.5(pid=16294): Launched 18:21:37.877179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:38.416103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16296): Launched 18:21:38.540335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:38.804927 run patchelf(pid=16297): Launched 18:21:38.980363 run osmo-stp_10.42.42.5(pid=16294): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16294)] 18:21:39.112144 run osmo-stp_10.42.42.5(pid=16294): stdout: | (launched: 2022-12-13_18:21:37.699837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:39.245501 run osmo-stp_10.42.42.5(pid=16294): stderr: | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182137871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:39.378459 run osmo-stp_10.42.42.5(pid=16294): stdout: | (launched: 2022-12-13_18:21:37.699837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:39.505624 run osmo-stp_10.42.42.5(pid=16294): stderr: | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182137870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182137871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182137871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:39.656236 run patchelf(pid=16297): Terminating (SIGINT) 18:21:39.833257 run patchelf(pid=16297): Terminated: ok {rc=0} 18:21:39.960925 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16294): Process ended prematurely: osmo-stp_10.42.42.5(pid=16294) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16294)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:21:39.970540 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:21:39.998007 run osmo-hlr_10.42.42.2(pid=16291): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16291)] 18:21:40.046385 run osmo-hlr_10.42.42.2(pid=16291): stdout: | (launched: 2022-12-13_18:21:36.714738) 18:21:40.096361 run osmo-hlr_10.42.42.2(pid=16291): stderr: | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182136892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182136905 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182136913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182136913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182136913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:40.146788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16284): Terminating (SIGTERM) 18:21:40.186806 run iperf3-srv_10.42.42.10(pid=16285): Terminating (SIGTERM) 18:21:40.226705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Terminating (SIGTERM) 18:21:40.266608 run iperf3-srv_10.42.42.10(pid=16287): Terminating (SIGTERM) 18:21:40.306212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16290): Terminating (SIGTERM) 18:21:40.346027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16293): Terminating (SIGTERM) 18:21:40.385892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16296): Terminating (SIGTERM) 18:21:40.426041 --- ParallelTerminationStrategy: PID 16284 died... 18:21:40.445445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16284): Terminated: ok {rc=0} 18:21:40.489807 --- ParallelTerminationStrategy: PID 16285 died... 18:21:40.508396 run iperf3-srv_10.42.42.10(pid=16285): Terminated {rc=256} 18:21:40.553203 --- ParallelTerminationStrategy: PID 16286 died... 18:21:40.572017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Terminated: ok {rc=0} 18:21:40.616173 --- ParallelTerminationStrategy: PID 16287 died... 18:21:40.634981 run iperf3-srv_10.42.42.10(pid=16287): Terminated {rc=256} 18:21:40.679027 --- ParallelTerminationStrategy: PID 16290 died... 18:21:40.697915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16290): Terminated: ok {rc=0} 18:21:40.742031 --- ParallelTerminationStrategy: PID 16293 died... 18:21:40.760895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16293): Terminated: ok {rc=0} 18:21:40.805286 --- ParallelTerminationStrategy: PID 16296 died... 18:21:40.824099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16296): Terminated: ok {rc=0} 18:21:40.908805 bus /gobi_0: Setting Powered False 18:21:42.006475 bus /gobi_0: Setting Powered False 18:21:43.122188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:21:44.271835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.283530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:44.338363 tst iperf3.py: using LAC 35412 18:21:44.462880 tst iperf3.py: using RAC 222 18:21:44.590674 tst iperf3.py: using CellId 35412 18:21:44.712012 tst iperf3.py: using BVCI 35413 18:21:44.825203 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.836187 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.846966 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.857841 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.868456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.879132 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.890494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.901493 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:44.912429 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:45.034979 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:45.261677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:45.598379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Launched 18:21:45.924829 run iperf3-srv_10.42.42.10(pid=16299): Launched 18:21:46.061783 tst iperf3.py:8: start network... 18:21:46.280138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:46.789050 run create_hlr_db(pid=16300): Launched 18:21:46.952746 bus /gobi_6: Setting Powered False 18:21:48.015430 run create_hlr_db(pid=16300): Terminated: ok {rc=0} 18:21:48.452063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Launched 18:21:48.767699 run osmo-hlr_10.42.42.2(pid=16303): Launched 18:21:48.887539 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:49.439092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Launched 18:21:49.754958 run osmo-stp_10.42.42.5(pid=16306): Launched 18:21:49.873083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:50.411756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Launched 18:21:50.533470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:50.798538 run patchelf(pid=16309): Launched 18:21:50.973963 run osmo-stp_10.42.42.5(pid=16306): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] 18:21:51.105633 run osmo-stp_10.42.42.5(pid=16306): stdout: | (launched: 2022-12-13_18:21:49.695483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:51.238825 run osmo-stp_10.42.42.5(pid=16306): stderr: | [0;m[38;5;43m20221213182149867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182149868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182149868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182149868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:51.372096 run osmo-stp_10.42.42.5(pid=16306): stdout: | (launched: 2022-12-13_18:21:49.695483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:51.499157 run osmo-stp_10.42.42.5(pid=16306): stderr: | [0;m[38;5;43m20221213182149867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182149868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182149868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182149868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182149869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:51.649638 run patchelf(pid=16309): Terminating (SIGINT) 18:21:51.827707 run patchelf(pid=16309): Terminated: ok {rc=0} 18:21:51.956047 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16306): Process ended prematurely: osmo-stp_10.42.42.5(pid=16306) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 18:21:51.965796 tst iperf3.py:8: Test FAILED (7.7 sec) 18:21:51.993214 run osmo-hlr_10.42.42.2(pid=16303): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16303)] 18:21:52.041902 run osmo-hlr_10.42.42.2(pid=16303): stdout: | (launched: 2022-12-13_18:21:48.709488) 18:21:52.091787 run osmo-hlr_10.42.42.2(pid=16303): stderr: | [0;m[1;31m20221213182148888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182148888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182148889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182148889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182148889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182148889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182148901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182148909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182148909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182148909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:52.141984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminating (SIGTERM) 18:21:52.182251 run iperf3-srv_10.42.42.10(pid=16299): Terminating (SIGTERM) 18:21:52.222414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Terminating (SIGTERM) 18:21:52.262436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Terminating (SIGTERM) 18:21:52.302498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Terminating (SIGTERM) 18:21:52.343082 --- ParallelTerminationStrategy: PID 16298 died... 18:21:52.362532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminated: ok {rc=0} 18:21:52.406971 --- ParallelTerminationStrategy: PID 16299 died... 18:21:52.426064 run iperf3-srv_10.42.42.10(pid=16299): Terminated {rc=256} 18:21:52.470782 --- ParallelTerminationStrategy: PID 16302 died... 18:21:52.489847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Terminated: ok {rc=0} 18:21:52.534395 --- ParallelTerminationStrategy: PID 16305 died... 18:21:52.553504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Terminated: ok {rc=0} 18:21:52.598151 --- ParallelTerminationStrategy: PID 16308 died... 18:21:52.617345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Terminated: ok {rc=0} 18:21:52.702592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:21:53.855208 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:53.867414 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:53.919233 tst iperf3m4.py: using LAC 35413 18:21:54.048892 tst iperf3m4.py: using RAC 223 18:21:54.179366 tst iperf3m4.py: using CellId 35413 18:21:54.314408 tst iperf3m4.py: using BVCI 35414 18:21:54.437971 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.449528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.460858 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.472154 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.483621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.495092 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.506981 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.518633 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:54.530441 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:54.651422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:54.777850 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:54.901193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:55.021575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:55.231595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:55.545557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Launched 18:21:55.846670 run iperf3-srv_10.42.42.10(pid=16311): Launched 18:21:55.972003 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:21:56.197757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:56.534440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16312): Launched 18:21:56.830669 run iperf3-srv_10.42.42.10(pid=16313): Launched 18:21:56.958123 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:21:57.183799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:57.520507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16314): Launched 18:21:57.812738 run iperf3-srv_10.42.42.10(pid=16315): Launched 18:21:57.939602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:21:58.165341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:58.502426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16316): Launched 18:21:58.798270 run iperf3-srv_10.42.42.10(pid=16317): Launched 18:21:58.925971 tst iperf3m4.py:8: start network... 18:21:59.151394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:59.668684 run create_hlr_db(pid=16318): Launched 18:21:59.796791 bus /gobi_6: Setting Powered False 18:22:00.885618 run create_hlr_db(pid=16318): Terminated: ok {rc=0} 18:22:01.353955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16320): Launched 18:22:01.695937 run osmo-hlr_10.42.42.2(pid=16321): Launched 18:22:01.943146 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:02.591226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16323): Launched 18:22:02.928527 run osmo-stp_10.42.42.5(pid=16324): Launched 18:22:03.056110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:03.628780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16326): Launched 18:22:03.757828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:04.040333 run patchelf(pid=16327): Launched 18:22:04.228332 run osmo-stp_10.42.42.5(pid=16324): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16324)] 18:22:04.369425 run osmo-stp_10.42.42.5(pid=16324): stdout: | (launched: 2022-12-13_18:22:02.866604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:04.512410 run osmo-stp_10.42.42.5(pid=16324): stderr: | [0;m[38;5;43m20221213182203060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182203061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182203061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182203061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:04.656266 run osmo-stp_10.42.42.5(pid=16324): stdout: | (launched: 2022-12-13_18:22:02.866604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:04.793108 run osmo-stp_10.42.42.5(pid=16324): stderr: | [0;m[38;5;43m20221213182203060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182203061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182203061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182203061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182203062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:04.954912 run patchelf(pid=16327): Terminating (SIGINT) 18:22:05.144283 run patchelf(pid=16327): Terminated: ok {rc=0} 18:22:05.280023 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16324): Process ended prematurely: osmo-stp_10.42.42.5(pid=16324) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16324)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 18:22:05.290440 tst iperf3m4.py:8: Test FAILED (11.5 sec) 18:22:05.319927 run osmo-hlr_10.42.42.2(pid=16321): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16321)] 18:22:05.371442 run osmo-hlr_10.42.42.2(pid=16321): stdout: | (launched: 2022-12-13_18:22:01.634286) 18:22:05.424650 run osmo-hlr_10.42.42.2(pid=16321): stderr: | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182202002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182202034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182202056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182202056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182202056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:05.478193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Terminating (SIGTERM) 18:22:05.520777 run iperf3-srv_10.42.42.10(pid=16311): Terminating (SIGTERM) 18:22:05.563510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16312): Terminating (SIGTERM) 18:22:05.606609 run iperf3-srv_10.42.42.10(pid=16313): Terminating (SIGTERM) 18:22:05.649390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16314): Terminating (SIGTERM) 18:22:05.692040 run iperf3-srv_10.42.42.10(pid=16315): Terminating (SIGTERM) 18:22:05.734476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16316): Terminating (SIGTERM) 18:22:05.777748 run iperf3-srv_10.42.42.10(pid=16317): Terminating (SIGTERM) 18:22:05.820605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16320): Terminating (SIGTERM) 18:22:05.863560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16323): Terminating (SIGTERM) 18:22:05.906277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16326): Terminating (SIGTERM) 18:22:05.949656 --- ParallelTerminationStrategy: PID 16310 died... 18:22:05.970628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Terminated: ok {rc=0} 18:22:06.017985 --- ParallelTerminationStrategy: PID 16311 died... 18:22:06.038179 run iperf3-srv_10.42.42.10(pid=16311): Terminated {rc=256} 18:22:06.085209 --- ParallelTerminationStrategy: PID 16312 died... 18:22:06.105578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16312): Terminated: ok {rc=0} 18:22:06.152579 --- ParallelTerminationStrategy: PID 16313 died... 18:22:06.172857 run iperf3-srv_10.42.42.10(pid=16313): Terminated {rc=256} 18:22:06.219758 --- ParallelTerminationStrategy: PID 16314 died... 18:22:06.240119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16314): Terminated: ok {rc=0} 18:22:06.287188 --- ParallelTerminationStrategy: PID 16315 died... 18:22:06.307274 run iperf3-srv_10.42.42.10(pid=16315): Terminated {rc=256} 18:22:06.354267 --- ParallelTerminationStrategy: PID 16316 died... 18:22:06.374402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16316): Terminated: ok {rc=0} 18:22:06.421833 --- ParallelTerminationStrategy: PID 16317 died... 18:22:06.442257 run iperf3-srv_10.42.42.10(pid=16317): Terminated {rc=256} 18:22:06.489771 --- ParallelTerminationStrategy: PID 16320 died... 18:22:06.510102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16320): Terminated: ok {rc=0} 18:22:06.557190 --- ParallelTerminationStrategy: PID 16323 died... 18:22:06.577551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16323): Terminated: ok {rc=0} 18:22:06.625065 --- ParallelTerminationStrategy: PID 16326 died... 18:22:06.645609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16326): Terminated: ok {rc=0} 18:22:06.736146 bus /gobi_4: Setting Powered False 18:22:07.836182 bus /gobi_4: Setting Powered False 18:22:08.953440 bus /gobi_1: Setting Powered False 18:22:10.052688 bus /gobi_1: Setting Powered False 18:22:11.169860 bus /gobi_0: Setting Powered False 18:22:12.268596 bus /gobi_0: Setting Powered False 18:22:13.389442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 18:22:14.493110 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:14.505037 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:14.555597 tst ping.py: using LAC 35414 18:22:14.677992 tst ping.py: using RAC 224 18:22:14.799089 tst ping.py: using CellId 35414 18:22:14.922270 tst ping.py: using BVCI 35415 18:22:15.034990 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.046238 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.057317 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.068141 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.078893 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.089648 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.100760 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:15.111602 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:15.232692 tst ping.py:19: start network... 18:22:15.454021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:15.974081 run create_hlr_db(pid=16328): Launched 18:22:16.133559 bus /gobi_6: Setting Powered False 18:22:17.198424 run create_hlr_db(pid=16328): Terminated: ok {rc=0} 18:22:17.644179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16330): Launched 18:22:17.953191 run osmo-hlr_10.42.42.2(pid=16331): Launched 18:22:18.070347 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:18.615436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16333): Launched 18:22:18.925173 run osmo-stp_10.42.42.5(pid=16334): Launched 18:22:19.043730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:19.572700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16336): Launched 18:22:19.691600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:19.950947 run patchelf(pid=16337): Launched 18:22:20.122718 run osmo-stp_10.42.42.5(pid=16334): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16334)] 18:22:20.252298 run osmo-stp_10.42.42.5(pid=16334): stdout: | (launched: 2022-12-13_18:22:18.867658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:20.383950 run osmo-stp_10.42.42.5(pid=16334): stderr: | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182219040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:20.516647 run osmo-stp_10.42.42.5(pid=16334): stdout: | (launched: 2022-12-13_18:22:18.867658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:20.642153 run osmo-stp_10.42.42.5(pid=16334): stderr: | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182219039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182219040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182219040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:20.790398 run patchelf(pid=16337): Terminating (SIGINT) 18:22:20.964843 run patchelf(pid=16337): Terminated: ok {rc=0} 18:22:21.089924 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16334): Process ended prematurely: osmo-stp_10.42.42.5(pid=16334) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16334)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 18:22:21.098943 tst ping.py:22: Test FAILED (6.6 sec) 18:22:21.126253 run osmo-hlr_10.42.42.2(pid=16331): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16331)] 18:22:21.174488 run osmo-hlr_10.42.42.2(pid=16331): stdout: | (launched: 2022-12-13_18:22:17.895940) 18:22:21.224278 run osmo-hlr_10.42.42.2(pid=16331): stderr: | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182218071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182218083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182218092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182218092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182218092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:21.274643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16330): Terminating (SIGTERM) 18:22:21.314779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16333): Terminating (SIGTERM) 18:22:21.354778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16336): Terminating (SIGTERM) 18:22:21.395105 --- ParallelTerminationStrategy: PID 16330 died... 18:22:21.414492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16330): Terminated: ok {rc=0} 18:22:21.458959 --- ParallelTerminationStrategy: PID 16333 died... 18:22:21.477930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16333): Terminated: ok {rc=0} 18:22:21.522240 --- ParallelTerminationStrategy: PID 16336 died... 18:22:21.540929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16336): Terminated: ok {rc=0} 18:22:21.626287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:22:22.713594 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:22.725823 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:22.779797 tst ping_idle_ping.py: using LAC 35415 18:22:22.909020 tst ping_idle_ping.py: using RAC 225 18:22:23.030749 tst ping_idle_ping.py: using CellId 35415 18:22:23.152224 tst ping_idle_ping.py: using BVCI 35416 18:22:23.264543 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.275756 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.286576 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.297379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.308048 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.318766 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.329780 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:23.340585 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:23.457150 tst ping_idle_ping.py:24: start network... 18:22:23.663532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:24.141694 run create_hlr_db(pid=16338): Launched 18:22:24.269128 bus /gobi_6: Setting Powered False 18:22:25.330422 run create_hlr_db(pid=16338): Terminated: ok {rc=0} 18:22:25.759611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16340): Launched 18:22:26.068800 run osmo-hlr_10.42.42.2(pid=16341): Launched 18:22:26.186773 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:26.712885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16343): Launched 18:22:27.022588 run osmo-stp_10.42.42.5(pid=16344): Launched 18:22:27.141457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:27.674034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16346): Launched 18:22:27.792930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:28.053627 run patchelf(pid=16347): Launched 18:22:28.225356 run osmo-stp_10.42.42.5(pid=16344): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16344)] 18:22:28.355214 run osmo-stp_10.42.42.5(pid=16344): stdout: | (launched: 2022-12-13_18:22:26.964505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:28.487369 run osmo-stp_10.42.42.5(pid=16344): stderr: | [0;m[38;5;43m20221213182227136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182227136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182227137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182227137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:28.619497 run osmo-stp_10.42.42.5(pid=16344): stdout: | (launched: 2022-12-13_18:22:26.964505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:28.745424 run osmo-stp_10.42.42.5(pid=16344): stderr: | [0;m[38;5;43m20221213182227136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182227136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182227137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182227137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182227138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:28.894106 run patchelf(pid=16347): Terminating (SIGINT) 18:22:29.069921 run patchelf(pid=16347): Terminated: ok {rc=0} 18:22:29.195586 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16344): Process ended prematurely: osmo-stp_10.42.42.5(pid=16344) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16344)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:22:29.204544 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:22:29.231955 run osmo-hlr_10.42.42.2(pid=16341): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16341)] 18:22:29.280494 run osmo-hlr_10.42.42.2(pid=16341): stdout: | (launched: 2022-12-13_18:22:26.011139) 18:22:29.330525 run osmo-hlr_10.42.42.2(pid=16341): stderr: | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182226187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182226199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182226210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182226210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182226210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:29.380778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16340): Terminating (SIGTERM) 18:22:29.421223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16343): Terminating (SIGTERM) 18:22:29.461610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16346): Terminating (SIGTERM) 18:22:29.502295 --- ParallelTerminationStrategy: PID 16340 died... 18:22:29.521182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16340): Terminated: ok {rc=0} 18:22:29.565929 --- ParallelTerminationStrategy: PID 16343 died... 18:22:29.585115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16343): Terminated: ok {rc=0} 18:22:29.629970 --- ParallelTerminationStrategy: PID 16346 died... 18:22:29.649237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16346): Terminated: ok {rc=0} 18:22:29.737346 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:22:31.061952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:22:31.069756 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:22:31.106323 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:22:31.149431 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:22:31.242420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:22:31.275579 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:22:31.315957 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:22:31.960464 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:22:32.033533 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.049769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:32.139152 tst cs_paging_gprs_active.py: using LAC 35416 18:22:32.283515 tst cs_paging_gprs_active.py: using RAC 226 18:22:32.425555 tst cs_paging_gprs_active.py: using CellId 35416 18:22:32.562880 tst cs_paging_gprs_active.py: using BVCI 35417 18:22:32.686140 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.697672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.708860 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.720158 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.731725 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.743271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.756330 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.767801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:32.779666 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:32.899911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:33.019624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:22:33.228382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:33.542328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Launched 18:22:33.817765 run iperf3-srv_10.42.42.10(pid=16352): Launched 18:22:33.937268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:22:34.146301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:34.461100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Launched 18:22:34.733810 run iperf3-srv_10.42.42.10(pid=16354): Launched 18:22:34.858744 tst cs_paging_gprs_active.py:38: start network... 18:22:35.068793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:35.553499 run create_hlr_db(pid=16355): Launched 18:22:35.684664 bus /gobi_6: Setting Powered False 18:22:36.751408 run create_hlr_db(pid=16355): Terminated: ok {rc=0} 18:22:37.216610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16357): Launched 18:22:37.554322 run osmo-hlr_10.42.42.2(pid=16358): Launched 18:22:37.684593 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:38.263889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16360): Launched 18:22:38.603051 run osmo-stp_10.42.42.5(pid=16361): Launched 18:22:38.731294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:39.310209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16363): Launched 18:22:39.439586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:39.723803 run patchelf(pid=16364): Launched 18:22:39.911863 run osmo-stp_10.42.42.5(pid=16361): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16361)] 18:22:40.054122 run osmo-stp_10.42.42.5(pid=16361): stdout: | (launched: 2022-12-13_18:22:38.540772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:40.198098 run osmo-stp_10.42.42.5(pid=16361): stderr: | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182238736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:40.342322 run osmo-stp_10.42.42.5(pid=16361): stdout: | (launched: 2022-12-13_18:22:38.540772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:40.479638 run osmo-stp_10.42.42.5(pid=16361): stderr: | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182238735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182238736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182238736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:40.642817 run patchelf(pid=16364): Terminating (SIGINT) 18:22:40.832881 run patchelf(pid=16364): Terminated: ok {rc=0} 18:22:40.969502 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16361): Process ended prematurely: osmo-stp_10.42.42.5(pid=16361) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16361)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:22:40.979795 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:22:41.009094 run osmo-hlr_10.42.42.2(pid=16358): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16358)] 18:22:41.061218 run osmo-hlr_10.42.42.2(pid=16358): stdout: | (launched: 2022-12-13_18:22:37.492226) 18:22:41.114686 run osmo-hlr_10.42.42.2(pid=16358): stderr: | [0;m[1;31m20221213182237691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182237692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182237692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182237692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182237692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182237692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182237704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182237712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182237713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182237713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:41.168569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Terminating (SIGTERM) 18:22:41.211033 run iperf3-srv_10.42.42.10(pid=16352): Terminating (SIGTERM) 18:22:41.254006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Terminating (SIGTERM) 18:22:41.296818 run iperf3-srv_10.42.42.10(pid=16354): Terminating (SIGTERM) 18:22:41.339639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16357): Terminating (SIGTERM) 18:22:41.382381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16360): Terminating (SIGTERM) 18:22:41.425316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16363): Terminating (SIGTERM) 18:22:41.468243 --- ParallelTerminationStrategy: PID 16351 died... 18:22:41.488655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Terminated: ok {rc=0} 18:22:41.535886 --- ParallelTerminationStrategy: PID 16352 died... 18:22:41.556165 run iperf3-srv_10.42.42.10(pid=16352): Terminated {rc=256} 18:22:41.603705 --- ParallelTerminationStrategy: PID 16353 died... 18:22:41.623960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Terminated: ok {rc=0} 18:22:41.671226 --- ParallelTerminationStrategy: PID 16354 died... 18:22:41.691472 run iperf3-srv_10.42.42.10(pid=16354): Terminated {rc=256} 18:22:41.738493 --- ParallelTerminationStrategy: PID 16357 died... 18:22:41.758726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16357): Terminated: ok {rc=0} 18:22:41.805803 --- ParallelTerminationStrategy: PID 16360 died... 18:22:41.826141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16360): Terminated: ok {rc=0} 18:22:41.873089 --- ParallelTerminationStrategy: PID 16363 died... 18:22:41.893541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16363): Terminated: ok {rc=0} 18:22:41.983897 bus /gobi_0: Setting Powered False 18:22:43.084025 bus /gobi_0: Setting Powered False 18:22:44.203682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:22:45.356709 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:45.368911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:45.441995 tst iperf3.py: using LAC 35417 18:22:45.573935 tst iperf3.py: using RAC 227 18:22:45.705827 tst iperf3.py: using CellId 35417 18:22:45.833331 tst iperf3.py: using BVCI 35418 18:22:45.963208 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:45.975333 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:45.988619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.003012 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.016574 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.031463 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.046343 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.061741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:46.076269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:46.199888 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:46.420088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:46.743852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Launched 18:22:47.033781 run iperf3-srv_10.42.42.10(pid=16366): Launched 18:22:47.175620 tst iperf3.py:8: start network... 18:22:47.404112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:47.922064 run create_hlr_db(pid=16367): Launched 18:22:48.052489 bus /gobi_6: Setting Powered False 18:22:49.118538 run create_hlr_db(pid=16367): Terminated: ok {rc=0} 18:22:49.565761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Launched 18:22:49.879685 run osmo-hlr_10.42.42.2(pid=16370): Launched 18:22:50.000094 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:50.539222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Launched 18:22:50.853494 run osmo-stp_10.42.42.5(pid=16373): Launched 18:22:50.973159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:51.515583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16375): Launched 18:22:51.638769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:51.907037 run patchelf(pid=16376): Launched 18:22:52.104847 run osmo-stp_10.42.42.5(pid=16373): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] 18:22:52.247234 run osmo-stp_10.42.42.5(pid=16373): stdout: | (launched: 2022-12-13_18:22:50.795019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:52.390430 run osmo-stp_10.42.42.5(pid=16373): stderr: | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182250968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:52.533660 run osmo-stp_10.42.42.5(pid=16373): stdout: | (launched: 2022-12-13_18:22:50.795019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:52.671296 run osmo-stp_10.42.42.5(pid=16373): stderr: | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182250968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182250968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182250969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:52.833493 run patchelf(pid=16376): Terminating (SIGINT) 18:22:53.023435 run patchelf(pid=16376): Terminated: ok {rc=0} 18:22:53.160560 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16373): Process ended prematurely: osmo-stp_10.42.42.5(pid=16373) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:22:53.170969 tst iperf3.py:8: Test FAILED (7.9 sec) 18:22:53.200282 run osmo-hlr_10.42.42.2(pid=16370): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16370)] 18:22:53.252496 run osmo-hlr_10.42.42.2(pid=16370): stdout: | (launched: 2022-12-13_18:22:49.821348) 18:22:53.305784 run osmo-hlr_10.42.42.2(pid=16370): stderr: | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182249999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182250015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182250025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182250025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182250025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:53.359743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminating (SIGTERM) 18:22:53.402477 run iperf3-srv_10.42.42.10(pid=16366): Terminating (SIGTERM) 18:22:53.446580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Terminating (SIGTERM) 18:22:53.489760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Terminating (SIGTERM) 18:22:53.532525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16375): Terminating (SIGTERM) 18:22:53.575673 --- ParallelTerminationStrategy: PID 16365 died... 18:22:53.596566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminated: ok {rc=0} 18:22:53.644461 --- ParallelTerminationStrategy: PID 16366 died... 18:22:53.664879 run iperf3-srv_10.42.42.10(pid=16366): Terminated {rc=256} 18:22:53.712151 --- ParallelTerminationStrategy: PID 16369 died... 18:22:53.732633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Terminated: ok {rc=0} 18:22:53.780065 --- ParallelTerminationStrategy: PID 16372 died... 18:22:53.800397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Terminated: ok {rc=0} 18:22:53.847922 --- ParallelTerminationStrategy: PID 16375 died... 18:22:53.868363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16375): Terminated: ok {rc=0} 18:22:53.958529 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:22:55.111237 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.123728 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:55.194469 tst iperf3m4.py: using LAC 35418 18:22:55.324936 tst iperf3m4.py: using RAC 228 18:22:55.455677 tst iperf3m4.py: using CellId 35418 18:22:55.580915 tst iperf3m4.py: using BVCI 35419 18:22:55.694669 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.705955 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.717117 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.727990 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.739056 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.749964 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.760849 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.771716 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:55.782682 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:55.904151 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:56.025278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:56.146956 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:56.270196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:56.495412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:56.831854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16377): Launched 18:22:57.126450 run iperf3-srv_10.42.42.10(pid=16378): Launched 18:22:57.254544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:22:57.480583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:57.818152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Launched 18:22:58.112690 run iperf3-srv_10.42.42.10(pid=16380): Launched 18:22:58.239755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:22:58.465650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:58.803332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16381): Launched 18:22:59.096855 run iperf3-srv_10.42.42.10(pid=16382): Launched 18:22:59.224462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:22:59.450851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:59.788756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16383): Launched 18:23:00.083406 run iperf3-srv_10.42.42.10(pid=16384): Launched 18:23:00.210559 tst iperf3m4.py:8: start network... 18:23:00.436237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:00.977381 run create_hlr_db(pid=16385): Launched 18:23:01.110851 bus /gobi_6: Setting Powered False 18:23:02.194643 run create_hlr_db(pid=16385): Terminated: ok {rc=0} 18:23:02.650693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16387): Launched 18:23:02.967207 run osmo-hlr_10.42.42.2(pid=16388): Launched 18:23:03.088599 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:03.644280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16390): Launched 18:23:03.960200 run osmo-stp_10.42.42.5(pid=16391): Launched 18:23:04.080817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:04.618737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16393): Launched 18:23:04.740367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:05.005537 run patchelf(pid=16394): Launched 18:23:05.180928 run osmo-stp_10.42.42.5(pid=16391): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16391)] 18:23:05.314121 run osmo-stp_10.42.42.5(pid=16391): stdout: | (launched: 2022-12-13_18:23:03.901456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:05.448061 run osmo-stp_10.42.42.5(pid=16391): stderr: | [0;m[38;5;43m20221213182304074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182304075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182304075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182304075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:05.582284 run osmo-stp_10.42.42.5(pid=16391): stdout: | (launched: 2022-12-13_18:23:03.901456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:05.710060 run osmo-stp_10.42.42.5(pid=16391): stderr: | [0;m[38;5;43m20221213182304074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182304075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182304075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182304075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182304076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:05.861444 run patchelf(pid=16394): Terminating (SIGINT) 18:23:06.039542 run patchelf(pid=16394): Terminated: ok {rc=0} 18:23:06.167614 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16391): Process ended prematurely: osmo-stp_10.42.42.5(pid=16391) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16391)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:23:06.177289 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:23:06.205007 run osmo-hlr_10.42.42.2(pid=16388): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16388)] 18:23:06.253454 run osmo-hlr_10.42.42.2(pid=16388): stdout: | (launched: 2022-12-13_18:23:02.908434) 18:23:06.303543 run osmo-hlr_10.42.42.2(pid=16388): stderr: | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182303086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182303098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182303106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182303106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182303106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:06.354054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16377): Terminating (SIGTERM) 18:23:06.394422 run iperf3-srv_10.42.42.10(pid=16378): Terminating (SIGTERM) 18:23:06.434777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Terminating (SIGTERM) 18:23:06.475097 run iperf3-srv_10.42.42.10(pid=16380): Terminating (SIGTERM) 18:23:06.515440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16381): Terminating (SIGTERM) 18:23:06.555912 run iperf3-srv_10.42.42.10(pid=16382): Terminating (SIGTERM) 18:23:06.596252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16383): Terminating (SIGTERM) 18:23:06.636715 run iperf3-srv_10.42.42.10(pid=16384): Terminating (SIGTERM) 18:23:06.677062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16387): Terminating (SIGTERM) 18:23:06.717304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16390): Terminating (SIGTERM) 18:23:06.757737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16393): Terminating (SIGTERM) 18:23:06.798583 --- ParallelTerminationStrategy: PID 16377 died... 18:23:06.818310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16377): Terminated: ok {rc=0} 18:23:06.863211 --- ParallelTerminationStrategy: PID 16378 died... 18:23:06.882392 run iperf3-srv_10.42.42.10(pid=16378): Terminated {rc=256} 18:23:06.926924 --- ParallelTerminationStrategy: PID 16379 died... 18:23:06.946112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Terminated: ok {rc=0} 18:23:06.991172 --- ParallelTerminationStrategy: PID 16380 died... 18:23:07.010367 run iperf3-srv_10.42.42.10(pid=16380): Terminated {rc=256} 18:23:07.055027 --- ParallelTerminationStrategy: PID 16381 died... 18:23:07.074127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16381): Terminated: ok {rc=0} 18:23:07.119215 --- ParallelTerminationStrategy: PID 16382 died... 18:23:07.138488 run iperf3-srv_10.42.42.10(pid=16382): Terminated {rc=256} 18:23:07.183139 --- ParallelTerminationStrategy: PID 16383 died... 18:23:07.202226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16383): Terminated: ok {rc=0} 18:23:07.247899 --- ParallelTerminationStrategy: PID 16384 died... 18:23:07.267145 run iperf3-srv_10.42.42.10(pid=16384): Terminated {rc=256} 18:23:07.311779 --- ParallelTerminationStrategy: PID 16387 died... 18:23:07.330864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16387): Terminated: ok {rc=0} 18:23:07.375379 --- ParallelTerminationStrategy: PID 16390 died... 18:23:07.394573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16390): Terminated: ok {rc=0} 18:23:07.439331 --- ParallelTerminationStrategy: PID 16393 died... 18:23:07.458624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16393): Terminated: ok {rc=0} 18:23:07.545063 bus /gobi_4: Setting Powered False 18:23:08.646453 bus /gobi_4: Setting Powered False 18:23:09.764852 bus /gobi_1: Setting Powered False 18:23:10.865350 bus /gobi_1: Setting Powered False 18:23:11.984310 bus /gobi_0: Setting Powered False 18:23:13.084053 bus /gobi_0: Setting Powered False 18:23:14.203646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:23:15.308577 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.321155 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:15.391382 tst ping.py: using LAC 35419 18:23:15.521357 tst ping.py: using RAC 229 18:23:15.652430 tst ping.py: using CellId 35419 18:23:15.773347 tst ping.py: using BVCI 35420 18:23:15.891577 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.908595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.921350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.935853 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.948269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.963398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.975841 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:15.989139 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:16.123919 tst ping.py:19: start network... 18:23:16.357451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:16.883888 run create_hlr_db(pid=16395): Launched 18:23:17.048093 bus /gobi_6: Setting Powered False 18:23:18.113909 run create_hlr_db(pid=16395): Terminated: ok {rc=0} 18:23:18.554702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16397): Launched 18:23:18.865332 run osmo-hlr_10.42.42.2(pid=16398): Launched 18:23:18.983383 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:19.521425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16400): Launched 18:23:19.830730 run osmo-stp_10.42.42.5(pid=16401): Launched 18:23:19.949086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:20.481639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16403): Launched 18:23:20.600079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:20.862480 run patchelf(pid=16404): Launched 18:23:21.035272 run osmo-stp_10.42.42.5(pid=16401): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16401)] 18:23:21.165187 run osmo-stp_10.42.42.5(pid=16401): stdout: | (launched: 2022-12-13_18:23:19.773063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:21.297358 run osmo-stp_10.42.42.5(pid=16401): stderr: | [0;m[38;5;43m20221213182319944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182319944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182319945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182319945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:21.429920 run osmo-stp_10.42.42.5(pid=16401): stdout: | (launched: 2022-12-13_18:23:19.773063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:21.555572 run osmo-stp_10.42.42.5(pid=16401): stderr: | [0;m[38;5;43m20221213182319944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182319944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182319945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182319945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182319946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:21.704893 run patchelf(pid=16404): Terminating (SIGINT) 18:23:21.879572 run patchelf(pid=16404): Terminated: ok {rc=0} 18:23:22.005371 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16401): Process ended prematurely: osmo-stp_10.42.42.5(pid=16401) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16401)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 18:23:22.014229 tst ping.py:22: Test FAILED (6.7 sec) 18:23:22.041661 run osmo-hlr_10.42.42.2(pid=16398): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16398)] 18:23:22.089893 run osmo-hlr_10.42.42.2(pid=16398): stdout: | (launched: 2022-12-13_18:23:18.807407) 18:23:22.139952 run osmo-hlr_10.42.42.2(pid=16398): stderr: | [0;m[1;31m20221213182318985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182318985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182318985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182318985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182318985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182318986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182318998 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182319007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182319008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182319008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:22.190449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16397): Terminating (SIGTERM) 18:23:22.230672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16400): Terminating (SIGTERM) 18:23:22.270898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16403): Terminating (SIGTERM) 18:23:22.311681 --- ParallelTerminationStrategy: PID 16397 died... 18:23:22.330857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16397): Terminated: ok {rc=0} 18:23:22.375964 --- ParallelTerminationStrategy: PID 16400 died... 18:23:22.395128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16400): Terminated: ok {rc=0} 18:23:22.440177 --- ParallelTerminationStrategy: PID 16403 died... 18:23:22.459403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16403): Terminated: ok {rc=0} 18:23:22.545410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:23:23.635402 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:23.648203 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:23.719182 tst ping_idle_ping.py: using LAC 35420 18:23:23.849753 tst ping_idle_ping.py: using RAC 230 18:23:23.977567 tst ping_idle_ping.py: using CellId 35420 18:23:24.099579 tst ping_idle_ping.py: using BVCI 35421 18:23:24.213056 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.224101 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.235030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.245876 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.257225 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.268580 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.280113 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:24.291554 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:24.415646 tst ping_idle_ping.py:24: start network... 18:23:24.640393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:25.153724 run create_hlr_db(pid=16405): Launched 18:23:25.282316 bus /gobi_6: Setting Powered False 18:23:26.347905 run create_hlr_db(pid=16405): Terminated: ok {rc=0} 18:23:26.791197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16407): Launched 18:23:27.102105 run osmo-hlr_10.42.42.2(pid=16408): Launched 18:23:27.221657 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:27.758567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16410): Launched 18:23:28.067633 run osmo-stp_10.42.42.5(pid=16411): Launched 18:23:28.186847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:28.718833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16413): Launched 18:23:28.837564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:29.099110 run patchelf(pid=16414): Launched 18:23:29.272623 run osmo-stp_10.42.42.5(pid=16411): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16411)] 18:23:29.403408 run osmo-stp_10.42.42.5(pid=16411): stdout: | (launched: 2022-12-13_18:23:28.009845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:29.535587 run osmo-stp_10.42.42.5(pid=16411): stderr: | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182328183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:29.667723 run osmo-stp_10.42.42.5(pid=16411): stdout: | (launched: 2022-12-13_18:23:28.009845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:29.793135 run osmo-stp_10.42.42.5(pid=16411): stderr: | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182328182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182328183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182328183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:29.942205 run patchelf(pid=16414): Terminating (SIGINT) 18:23:30.116353 run patchelf(pid=16414): Terminated: ok {rc=0} 18:23:30.242594 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16411): Process ended prematurely: osmo-stp_10.42.42.5(pid=16411) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16411)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:23:30.251805 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:23:30.279068 run osmo-hlr_10.42.42.2(pid=16408): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16408)] 18:23:30.327249 run osmo-hlr_10.42.42.2(pid=16408): stdout: | (launched: 2022-12-13_18:23:27.044233) 18:23:30.377312 run osmo-hlr_10.42.42.2(pid=16408): stderr: | [0;m[1;31m20221213182327221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182327221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182327221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182327221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182327221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182327222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182327234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182327242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182327242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182327242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:30.427940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16407): Terminating (SIGTERM) 18:23:30.467888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16410): Terminating (SIGTERM) 18:23:30.507912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16413): Terminating (SIGTERM) 18:23:30.548371 --- ParallelTerminationStrategy: PID 16407 died... 18:23:30.567897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16407): Terminated: ok {rc=0} 18:23:30.612463 --- ParallelTerminationStrategy: PID 16410 died... 18:23:30.631414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16410): Terminated: ok {rc=0} 18:23:30.676065 --- ParallelTerminationStrategy: PID 16413 died... 18:23:30.694937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16413): Terminated: ok {rc=0} 18:23:30.779216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:23:32.102130 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:23:32.117272 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:23:32.155721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 18:23:32.207934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 18:23:32.303329 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:23:32.338608 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 18:23:32.380628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 18:23:32.971839 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 18:23:33.026516 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.038359 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:33.087598 tst cs_paging_gprs_active.py: using LAC 35421 18:23:33.208639 tst cs_paging_gprs_active.py: using RAC 231 18:23:33.327713 tst cs_paging_gprs_active.py: using CellId 35421 18:23:33.447277 tst cs_paging_gprs_active.py: using BVCI 35422 18:23:33.569364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.581240 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.593022 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.604600 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.617239 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.629954 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.642605 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.655033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.667710 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:33.792152 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:33.910907 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:23:34.118423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:34.429839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16423): Launched 18:23:34.701171 run iperf3-srv_10.42.42.10(pid=16424): Launched 18:23:34.816912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:23:35.022834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:35.333359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16425): Launched 18:23:35.603997 run iperf3-srv_10.42.42.10(pid=16426): Launched 18:23:35.720002 tst cs_paging_gprs_active.py:38: start network... 18:23:35.926207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:36.405802 run create_hlr_db(pid=16427): Launched 18:23:36.534074 bus /gobi_6: Setting Powered False 18:23:37.599105 run create_hlr_db(pid=16427): Terminated: ok {rc=0} 18:23:38.042803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16429): Launched 18:23:38.354105 run osmo-hlr_10.42.42.2(pid=16430): Launched 18:23:38.472512 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:39.006500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16432): Launched 18:23:39.317387 run osmo-stp_10.42.42.5(pid=16433): Launched 18:23:39.435235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:39.973745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16435): Launched 18:23:40.093719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:40.357820 run patchelf(pid=16436): Launched 18:23:40.530783 run osmo-stp_10.42.42.5(pid=16433): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16433)] 18:23:40.662036 run osmo-stp_10.42.42.5(pid=16433): stdout: | (launched: 2022-12-13_18:23:39.259485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:40.794800 run osmo-stp_10.42.42.5(pid=16433): stderr: | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182339433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:40.927617 run osmo-stp_10.42.42.5(pid=16433): stdout: | (launched: 2022-12-13_18:23:39.259485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:41.054067 run osmo-stp_10.42.42.5(pid=16433): stderr: | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182339432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182339433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182339433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:41.203801 run patchelf(pid=16436): Terminating (SIGINT) 18:23:41.379663 run patchelf(pid=16436): Terminated: ok {rc=0} 18:23:41.507192 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16433): Process ended prematurely: osmo-stp_10.42.42.5(pid=16433) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16433)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 18:23:41.516834 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:23:41.544282 run osmo-hlr_10.42.42.2(pid=16430): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16430)] 18:23:41.592805 run osmo-hlr_10.42.42.2(pid=16430): stdout: | (launched: 2022-12-13_18:23:38.296468) 18:23:41.643091 run osmo-hlr_10.42.42.2(pid=16430): stderr: | [0;m[1;31m20221213182338471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182338471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182338471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182338471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182338472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182338472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182338486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182338497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182338497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182338497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:41.693824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16423): Terminating (SIGTERM) 18:23:41.734140 run iperf3-srv_10.42.42.10(pid=16424): Terminating (SIGTERM) 18:23:41.774349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16425): Terminating (SIGTERM) 18:23:41.814730 run iperf3-srv_10.42.42.10(pid=16426): Terminating (SIGTERM) 18:23:41.855041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16429): Terminating (SIGTERM) 18:23:41.895554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16432): Terminating (SIGTERM) 18:23:41.935976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16435): Terminating (SIGTERM) 18:23:41.976571 --- ParallelTerminationStrategy: PID 16423 died... 18:23:41.996016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16423): Terminated: ok {rc=0} 18:23:42.040682 --- ParallelTerminationStrategy: PID 16424 died... 18:23:42.059588 run iperf3-srv_10.42.42.10(pid=16424): Terminated {rc=256} 18:23:42.103876 --- ParallelTerminationStrategy: PID 16425 died... 18:23:42.122761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16425): Terminated: ok {rc=0} 18:23:42.167214 --- ParallelTerminationStrategy: PID 16426 died... 18:23:42.185934 run iperf3-srv_10.42.42.10(pid=16426): Terminated {rc=256} 18:23:42.230298 --- ParallelTerminationStrategy: PID 16429 died... 18:23:42.249218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16429): Terminated: ok {rc=0} 18:23:42.293509 --- ParallelTerminationStrategy: PID 16432 died... 18:23:42.312240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16432): Terminated: ok {rc=0} 18:23:42.357296 --- ParallelTerminationStrategy: PID 16435 died... 18:23:42.376195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16435): Terminated: ok {rc=0} 18:23:42.463937 bus /gobi_0: Setting Powered False 18:23:43.566660 bus /gobi_0: Setting Powered False 18:23:44.682517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 18:23:45.840274 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:45.853720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:45.908927 tst iperf3.py: using LAC 35422 18:23:46.037493 tst iperf3.py: using RAC 232 18:23:46.158510 tst iperf3.py: using CellId 35422 18:23:46.330245 tst iperf3.py: using BVCI 35423 18:23:46.444616 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.456582 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.468576 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.481195 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.493828 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.506523 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.519095 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.531570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:46.544232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:46.690133 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:46.921173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:47.279648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16447): Launched 18:23:47.589075 run iperf3-srv_10.42.42.10(pid=16448): Launched 18:23:47.728091 tst iperf3.py:8: start network... 18:23:47.958219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:48.477641 run create_hlr_db(pid=16450): Launched 18:23:48.646215 bus /gobi_6: Setting Powered False 18:23:49.712057 run create_hlr_db(pid=16450): Terminated: ok {rc=0} 18:23:50.183310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16452): Launched 18:23:50.512623 run osmo-hlr_10.42.42.2(pid=16453): Launched 18:23:50.752213 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:51.448109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Launched 18:23:51.776753 run osmo-stp_10.42.42.5(pid=16458): Launched 18:23:52.024846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:52.681623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16460): Launched 18:23:52.822155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:53.142370 run patchelf(pid=16479): Launched 18:23:53.348364 run osmo-stp_10.42.42.5(pid=16458): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] 18:23:53.508645 run osmo-stp_10.42.42.5(pid=16458): stdout: | (launched: 2022-12-13_18:23:51.717524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:53.656457 run osmo-stp_10.42.42.5(pid=16458): stderr: | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182352006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:53.825877 run osmo-stp_10.42.42.5(pid=16458): stdout: | (launched: 2022-12-13_18:23:51.717524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:53.976284 run osmo-stp_10.42.42.5(pid=16458): stderr: | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182352005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182352006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182352006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:54.173098 run patchelf(pid=16479): Terminating (SIGINT) 18:23:54.395482 run patchelf(pid=16479): Terminated: ok {rc=0} 18:23:54.561575 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16458): Process ended prematurely: osmo-stp_10.42.42.5(pid=16458) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 18:23:54.577788 tst iperf3.py:8: Test FAILED (8.8 sec) 18:23:54.618350 run osmo-hlr_10.42.42.2(pid=16453): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16453)] 18:23:54.686774 run osmo-hlr_10.42.42.2(pid=16453): stdout: | (launched: 2022-12-13_18:23:50.453966) 18:23:54.760334 run osmo-hlr_10.42.42.2(pid=16453): stderr: | [0;m[1;31m20221213182350793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182350793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182350793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182350793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182350793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182350794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182350808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182350816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182350816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182350816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:54.833812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16447): Terminating (SIGTERM) 18:23:54.889010 run iperf3-srv_10.42.42.10(pid=16448): Terminating (SIGTERM) 18:23:54.949677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16452): Terminating (SIGTERM) 18:23:55.005933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Terminating (SIGTERM) 18:23:55.061335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16460): Terminating (SIGTERM) 18:23:55.117206 --- ParallelTerminationStrategy: PID 16447 died... 18:23:55.142776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16447): Terminated: ok {rc=0} 18:23:55.207199 --- ParallelTerminationStrategy: PID 16448 died... 18:23:55.230371 run iperf3-srv_10.42.42.10(pid=16448): Terminated {rc=256} 18:23:55.293766 --- ParallelTerminationStrategy: PID 16452 died... 18:23:55.319886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16452): Terminated: ok {rc=0} 18:23:55.384784 --- ParallelTerminationStrategy: PID 16457 died... 18:23:55.412653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Terminated: ok {rc=0} 18:23:55.473280 --- ParallelTerminationStrategy: PID 16460 died... 18:23:55.495949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16460): Terminated: ok {rc=0} 18:23:55.612644 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 18:23:56.778756 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:56.792411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:56.849781 tst iperf3m4.py: using LAC 35423 18:23:56.982302 tst iperf3m4.py: using RAC 233 18:23:57.113764 tst iperf3m4.py: using CellId 35423 18:23:57.248232 tst iperf3m4.py: using BVCI 35424 18:23:57.373493 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.386477 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.399298 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.412083 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.426043 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.439977 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.455070 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.469036 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:57.483867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:57.617516 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:57.748380 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:57.879831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:58.009116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:58.241268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:58.586295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16721): Launched 18:23:58.899010 run iperf3-srv_10.42.42.10(pid=16722): Launched 18:23:59.040449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:23:59.271019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:59.614471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16723): Launched 18:23:59.926040 run iperf3-srv_10.42.42.10(pid=16724): Launched 18:24:00.068054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:24:00.298173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:00.645228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16725): Launched 18:24:00.959378 run iperf3-srv_10.42.42.10(pid=16726): Launched 18:24:01.115133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:24:01.367126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:01.819186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16727): Launched 18:24:02.181332 run iperf3-srv_10.42.42.10(pid=16728): Launched 18:24:02.410611 tst iperf3m4.py:8: start network... 18:24:02.684216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:03.185735 run create_hlr_db(pid=16729): Launched 18:24:03.403053 bus /gobi_6: Setting Powered False 18:24:04.469360 run create_hlr_db(pid=16729): Terminated: ok {rc=0} 18:24:04.985651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16731): Launched 18:24:05.338576 run osmo-hlr_10.42.42.2(pid=16732): Launched 18:24:05.595983 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:06.279225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16734): Launched 18:24:06.634041 run osmo-stp_10.42.42.5(pid=16735): Launched 18:24:06.897138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:07.559354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16737): Launched 18:24:07.753192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:08.045125 run patchelf(pid=16738): Launched 18:24:08.249265 run osmo-stp_10.42.42.5(pid=16735): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16735)] 18:24:08.396162 run osmo-stp_10.42.42.5(pid=16735): stdout: | (launched: 2022-12-13_18:24:06.571606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:08.544432 run osmo-stp_10.42.42.5(pid=16735): stderr: | [0;m[38;5;43m20221213182406869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182406870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182406870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182406870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:08.693789 run osmo-stp_10.42.42.5(pid=16735): stdout: | (launched: 2022-12-13_18:24:06.571606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:08.836888 run osmo-stp_10.42.42.5(pid=16735): stderr: | [0;m[38;5;43m20221213182406869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182406870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182406870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182406870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182406871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:09.006364 run patchelf(pid=16738): Terminating (SIGINT) 18:24:09.203002 run patchelf(pid=16738): Terminated: ok {rc=0} 18:24:09.344160 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16735): Process ended prematurely: osmo-stp_10.42.42.5(pid=16735) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16735)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 18:24:09.357285 tst iperf3m4.py:8: Test FAILED (12.6 sec) 18:24:09.389494 run osmo-hlr_10.42.42.2(pid=16732): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16732)] 18:24:09.444351 run osmo-hlr_10.42.42.2(pid=16732): stdout: | (launched: 2022-12-13_18:24:05.276520) 18:24:09.500593 run osmo-hlr_10.42.42.2(pid=16732): stderr: | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182405586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182405602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182405611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182405611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182405611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:09.559116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16721): Terminating (SIGTERM) 18:24:09.604471 run iperf3-srv_10.42.42.10(pid=16722): Terminating (SIGTERM) 18:24:09.653369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16723): Terminating (SIGTERM) 18:24:09.700359 run iperf3-srv_10.42.42.10(pid=16724): Terminating (SIGTERM) 18:24:09.748854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16725): Terminating (SIGTERM) 18:24:09.797832 run iperf3-srv_10.42.42.10(pid=16726): Terminating (SIGTERM) 18:24:09.846504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16727): Terminating (SIGTERM) 18:24:09.893647 run iperf3-srv_10.42.42.10(pid=16728): Terminating (SIGTERM) 18:24:09.942118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16731): Terminating (SIGTERM) 18:24:09.989172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16734): Terminating (SIGTERM) 18:24:10.037291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16737): Terminating (SIGTERM) 18:24:10.085208 --- ParallelTerminationStrategy: PID 16721 died... 18:24:10.108232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16721): Terminated: ok {rc=0} 18:24:10.161696 --- ParallelTerminationStrategy: PID 16722 died... 18:24:10.183164 run iperf3-srv_10.42.42.10(pid=16722): Terminated {rc=256} 18:24:10.233811 --- ParallelTerminationStrategy: PID 16723 died... 18:24:10.256090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16723): Terminated: ok {rc=0} 18:24:10.306653 --- ParallelTerminationStrategy: PID 16724 died... 18:24:10.328818 run iperf3-srv_10.42.42.10(pid=16724): Terminated {rc=256} 18:24:10.381770 --- ParallelTerminationStrategy: PID 16725 died... 18:24:10.402866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16725): Terminated: ok {rc=0} 18:24:10.452937 --- ParallelTerminationStrategy: PID 16726 died... 18:24:10.475299 run iperf3-srv_10.42.42.10(pid=16726): Terminated {rc=256} 18:24:10.525435 --- ParallelTerminationStrategy: PID 16727 died... 18:24:10.547922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16727): Terminated: ok {rc=0} 18:24:10.602239 --- ParallelTerminationStrategy: PID 16728 died... 18:24:10.623788 run iperf3-srv_10.42.42.10(pid=16728): Terminated {rc=256} 18:24:10.675774 --- ParallelTerminationStrategy: PID 16731 died... 18:24:10.697243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16731): Terminated: ok {rc=0} 18:24:10.747394 --- ParallelTerminationStrategy: PID 16734 died... 18:24:10.771918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16734): Terminated: ok {rc=0} 18:24:10.823946 --- ParallelTerminationStrategy: PID 16737 died... 18:24:10.846244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16737): Terminated: ok {rc=0} 18:24:10.941710 bus /gobi_4: Setting Powered False 18:24:12.042931 bus /gobi_4: Setting Powered False 18:24:13.163005 bus /gobi_1: Setting Powered False 18:24:14.263707 bus /gobi_1: Setting Powered False 18:24:15.381398 bus /gobi_0: Setting Powered False 18:24:16.483986 bus /gobi_0: Setting Powered False 18:24:17.605785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 18:24:18.710873 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:18.723665 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:24:18.779282 tst ping.py: using LAC 35424 18:24:18.905182 tst ping.py: using RAC 234 18:24:19.028848 tst ping.py: using CellId 35424 18:24:19.153426 tst ping.py: using BVCI 35425 18:24:19.270062 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.282265 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.294074 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.306027 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.318187 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.330398 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.342711 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:19.354808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:24:19.473536 tst ping.py:19: start network... 18:24:19.677871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:20.148697 run create_hlr_db(pid=16740): Launched 18:24:20.272242 bus /gobi_6: Setting Powered False 18:24:21.333465 run create_hlr_db(pid=16740): Terminated: ok {rc=0} 18:24:21.778330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16742): Launched 18:24:22.105613 run osmo-hlr_10.42.42.2(pid=16743): Launched 18:24:22.231057 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:22.793743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16745): Launched 18:24:23.121533 run osmo-stp_10.42.42.5(pid=16746): Launched 18:24:23.247184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:23.810409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16748): Launched 18:24:23.934997 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:24.210874 run patchelf(pid=16749): Launched 18:24:24.391898 run osmo-stp_10.42.42.5(pid=16746): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16746)] 18:24:24.529661 run osmo-stp_10.42.42.5(pid=16746): stdout: | (launched: 2022-12-13_18:24:23.061095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:24.669793 run osmo-stp_10.42.42.5(pid=16746): stderr: | [0;m[38;5;43m20221213182423257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182423257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182423258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182423258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:24.809723 run osmo-stp_10.42.42.5(pid=16746): stdout: | (launched: 2022-12-13_18:24:23.061095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:24.943242 run osmo-stp_10.42.42.5(pid=16746): stderr: | [0;m[38;5;43m20221213182423257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182423257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182423258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182423258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182423258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:25.101559 run patchelf(pid=16749): Terminating (SIGINT) 18:24:25.285490 run patchelf(pid=16749): Terminated: ok {rc=0} 18:24:25.417842 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16746): Process ended prematurely: osmo-stp_10.42.42.5(pid=16746) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16746)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 18:24:25.427656 tst ping.py:22: Test FAILED (6.7 sec) 18:24:25.456292 run osmo-hlr_10.42.42.2(pid=16743): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16743)] 18:24:25.508211 run osmo-hlr_10.42.42.2(pid=16743): stdout: | (launched: 2022-12-13_18:24:22.045197) 18:24:25.561768 run osmo-hlr_10.42.42.2(pid=16743): stderr: | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182422246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182422277 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182422287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182422288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182422288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:25.615708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16742): Terminating (SIGTERM) 18:24:25.658605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16745): Terminating (SIGTERM) 18:24:25.702172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16748): Terminating (SIGTERM) 18:24:25.745419 --- ParallelTerminationStrategy: PID 16742 died... 18:24:25.766446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16742): Terminated: ok {rc=0} 18:24:25.814015 --- ParallelTerminationStrategy: PID 16745 died... 18:24:25.834312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16745): Terminated: ok {rc=0} 18:24:25.881849 --- ParallelTerminationStrategy: PID 16748 died... 18:24:25.902240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16748): Terminated: ok {rc=0} 18:24:25.992110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 18:24:27.082164 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.094932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:24:27.148665 tst ping_idle_ping.py: using LAC 35425 18:24:27.277776 tst ping_idle_ping.py: using RAC 235 18:24:27.399017 tst ping_idle_ping.py: using CellId 35425 18:24:27.520168 tst ping_idle_ping.py: using BVCI 35426 18:24:27.632702 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.644511 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.655935 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.667493 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.678735 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.690077 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.701454 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:24:27.712697 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:24:27.834447 tst ping_idle_ping.py:24: start network... 18:24:28.055337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:28.563447 run create_hlr_db(pid=16750): Launched 18:24:28.691009 bus /gobi_6: Setting Powered False 18:24:29.755388 run create_hlr_db(pid=16750): Terminated: ok {rc=0} 18:24:30.212588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Launched 18:24:30.542937 run osmo-hlr_10.42.42.2(pid=16753): Launched 18:24:30.671573 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:31.247613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16755): Launched 18:24:31.601293 run osmo-stp_10.42.42.5(pid=16756): Launched 18:24:31.847659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:32.468342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16758): Launched 18:24:32.594866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:32.871817 run patchelf(pid=16759): Launched 18:24:33.055169 run osmo-stp_10.42.42.5(pid=16756): ERR: Terminated: ERROR {rc=1} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16756)] 18:24:33.193645 run osmo-stp_10.42.42.5(pid=16756): stdout: | (launched: 2022-12-13_18:24:31.540387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:33.333703 run osmo-stp_10.42.42.5(pid=16756): stderr: | [0;m[38;5;43m20221213182431831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182431832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182431832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182431832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:33.473667 run osmo-stp_10.42.42.5(pid=16756): stdout: | (launched: 2022-12-13_18:24:31.540387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:33.607214 run osmo-stp_10.42.42.5(pid=16756): stderr: | [0;m[38;5;43m20221213182431831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182431832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182431832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182431832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182431833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:33.765810 run patchelf(pid=16759): Terminating (SIGINT) 18:24:33.949278 run patchelf(pid=16759): Terminated: ok {rc=0} 18:24:34.081487 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16756): Process ended prematurely: osmo-stp_10.42.42.5(pid=16756) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16756)] [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 18:24:34.091348 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 18:24:34.119817 run osmo-hlr_10.42.42.2(pid=16753): ERR: Terminated: ERROR {rc=237} [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16753)] 18:24:34.171326 run osmo-hlr_10.42.42.2(pid=16753): stdout: | (launched: 2022-12-13_18:24:30.482197) 18:24:34.224237 run osmo-hlr_10.42.42.2(pid=16753): stderr: | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182430683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182430697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182430707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182430707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182430707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:34.277690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Terminating (SIGTERM) 18:24:34.320303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16755): Terminating (SIGTERM) 18:24:34.363522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16758): Terminating (SIGTERM) 18:24:34.406369 --- ParallelTerminationStrategy: PID 16752 died... 18:24:34.426984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Terminated: ok {rc=0} 18:24:34.474075 --- ParallelTerminationStrategy: PID 16755 died... 18:24:34.494300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16755): Terminated: ok {rc=0} 18:24:34.541289 --- ParallelTerminationStrategy: PID 16758 died... 18:24:34.561455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16758): Terminated: ok {rc=0} 18:24:34.650576 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:24:35.968653 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:24:35.977807 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:24:36.011352 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:24:36.047028 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:24:36.101816 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:24:36.135363 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:24:36.171527 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:24:36.729839 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2392 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:24:36.735236 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:36.746935 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:24:36.813938 tst switch_tch_pdch.py: using LAC 35426 18:24:36.937252 tst switch_tch_pdch.py: using RAC 236 18:24:37.056008 tst switch_tch_pdch.py: using CellId 35426 18:24:37.173759 tst switch_tch_pdch.py: using BVCI 35427 18:24:37.293559 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.305820 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.317928 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.330299 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.342870 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.355334 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.367985 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:24:37.380517 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:24:37.498352 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:24:37.618265 tst switch_tch_pdch.py:51: start network... 18:24:37.822455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:38.295207 run create_hlr_db(pid=16765): Launched 18:24:38.421471 bus /gobi_6: Setting Powered False 18:24:39.482029 run create_hlr_db(pid=16765): Terminated: ok {rc=0} 18:24:39.927230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Launched 18:24:40.254660 run osmo-hlr_10.42.42.2(pid=16768): Launched 18:24:40.380869 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:40.940916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Launched 18:24:41.267709 run osmo-stp_10.42.42.5(pid=16771): Launched 18:24:41.393203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:41.956628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Launched 18:24:42.081890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:42.358128 run patchelf(pid=16774): Launched 18:24:42.539551 run osmo-stp_10.42.42.5(pid=16771): ERR: Terminated: ERROR {rc=1} [trial-2392↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] 18:24:42.678604 run osmo-stp_10.42.42.5(pid=16771): stdout: | (launched: 2022-12-13_18:24:41.207835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:42.819352 run osmo-stp_10.42.42.5(pid=16771): stderr: | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182441400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:42.960092 run osmo-stp_10.42.42.5(pid=16771): stdout: | (launched: 2022-12-13_18:24:41.207835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:43.094064 run osmo-stp_10.42.42.5(pid=16771): stderr: | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182441399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182441400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182441400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:43.252523 run patchelf(pid=16774): Terminating (SIGINT) 18:24:43.437127 run patchelf(pid=16774): Terminated: ok {rc=0} 18:24:43.570051 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16771): Process ended prematurely: osmo-stp_10.42.42.5(pid=16771) [trial-2392↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] [trial-2392↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:24:43.579919 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:24:43.608441 run osmo-hlr_10.42.42.2(pid=16768): ERR: Terminated: ERROR {rc=237} [trial-2392↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16768)] 18:24:43.661650 run osmo-hlr_10.42.42.2(pid=16768): stdout: | (launched: 2022-12-13_18:24:40.194535) 18:24:43.715342 run osmo-hlr_10.42.42.2(pid=16768): stderr: | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182440393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182440410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182440420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182440421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182440421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:43.769086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Terminating (SIGTERM) 18:24:43.811971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Terminating (SIGTERM) 18:24:43.855327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Terminating (SIGTERM) 18:24:43.898913 --- ParallelTerminationStrategy: PID 16767 died... 18:24:43.919914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Terminated: ok {rc=0} 18:24:43.967492 --- ParallelTerminationStrategy: PID 16770 died... 18:24:43.988046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Terminated: ok {rc=0} 18:24:44.035726 --- ParallelTerminationStrategy: PID 16773 died... 18:24:44.056087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Terminated: ok {rc=0} 18:24:44.147147 bus /gobi_0: Setting Powered False 18:24:45.247333 bus /gobi_0: Setting Powered False 18:24:46.374620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2392 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 nitb_smpp --------------------------------------------------------------------- 18:24:47.634592 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:24:47.637081 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 18:24:47.657654 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 18:24:47.664350 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 18:24:47.698793 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 18:24:47.719387 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 18:24:47.726009 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 18:24:48.246056 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2392 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:24:48.251082 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:48.269618 tst esme_connect_policy_acceptall.py: using MSISDN 8263 18:24:48.411494 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:48.994380 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16779): Launched 18:24:49.308087 run osmo-nitb_10.42.42.2(pid=16780): Launched 18:24:49.480926 run osmo-nitb_10.42.42.2(pid=16780): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16780)] 18:24:49.620267 run osmo-nitb_10.42.42.2(pid=16780): stdout: | (launched: 2022-12-13_18:24:49.250548) 18:24:49.760750 run osmo-nitb_10.42.42.2(pid=16780): stderr: | (launched: 2022-12-13_18:24:49.296628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:49.901737 run osmo-nitb_10.42.42.2(pid=16780): stdout: | (launched: 2022-12-13_18:24:49.250548) 18:24:50.037404 run osmo-nitb_10.42.42.2(pid=16780): stderr: | (launched: 2022-12-13_18:24:49.296628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16780): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16780) [trial-2392↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16780)] 18:24:50.425760 tst osmo-nitb_10.42.42.2(pid=16780): stdout: | (launched: 2022-12-13_18:24:49.250548) 18:24:50.560856 tst osmo-nitb_10.42.42.2(pid=16780): stderr: | (launched: 2022-12-13_18:24:49.296628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:50.721112 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=16780): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16780) [trial-2392↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16780)] [trial-2392↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 18:24:50.730469 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 18:24:50.737831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16779): Terminating (SIGTERM) 18:24:50.950058 --- ParallelTerminationStrategy: PID 16779 died... 18:24:50.972226 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16779): Terminated: ok {rc=0} ---------------------------------------------- trial-2392 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 18:24:51.025777 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:51.046244 tst esme_connect_policy_closed.py: using MSISDN 8264 18:24:51.179436 tst esme_connect_policy_closed.py: using MSISDN 8265 18:24:51.302368 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:51.924737 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16782): Launched 18:24:52.260935 run osmo-nitb_10.42.42.2(pid=16783): Launched 18:24:52.441489 run osmo-nitb_10.42.42.2(pid=16783): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16783)] 18:24:52.578359 run osmo-nitb_10.42.42.2(pid=16783): stdout: | (launched: 2022-12-13_18:24:52.199562) 18:24:52.717290 run osmo-nitb_10.42.42.2(pid=16783): stderr: | (launched: 2022-12-13_18:24:52.249200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:52.855826 run osmo-nitb_10.42.42.2(pid=16783): stdout: | (launched: 2022-12-13_18:24:52.199562) 18:24:52.989277 run osmo-nitb_10.42.42.2(pid=16783): stderr: | (launched: 2022-12-13_18:24:52.249200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:53.147693 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=16783): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16783) [trial-2392↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16783)] [trial-2392↪nitb_smpp↪esme_connect_policy_closed.py:24] 18:24:53.156836 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 18:24:53.164076 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16782): Terminating (SIGTERM) 18:24:53.375702 --- ParallelTerminationStrategy: PID 16782 died... 18:24:53.397417 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16782): Terminated: ok {rc=0} ---------------------------------------------- trial-2392 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:24:53.450025 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:53.461782 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:24:53.498394 tst esme_ms_sms_storeforward.py: using LAC 35427 18:24:53.622267 tst esme_ms_sms_storeforward.py: using RAC 237 18:24:53.750509 tst esme_ms_sms_storeforward.py: using CellId 35427 18:24:53.872782 tst esme_ms_sms_storeforward.py: using BVCI 35428 18:24:53.985685 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:24:54.115276 tst esme_ms_sms_storeforward.py: using MSISDN 8266 18:24:54.238801 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 18:24:54.466490 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:55.149103 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16784): Launched 18:24:55.486006 run osmo-nitb_10.42.42.2(pid=16785): Launched 18:24:55.667185 run osmo-nitb_10.42.42.2(pid=16785): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16785)] 18:24:55.805597 run osmo-nitb_10.42.42.2(pid=16785): stdout: | (launched: 2022-12-13_18:24:55.424391) 18:24:55.945059 run osmo-nitb_10.42.42.2(pid=16785): stderr: | (launched: 2022-12-13_18:24:55.474200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:56.084415 run osmo-nitb_10.42.42.2(pid=16785): stdout: | (launched: 2022-12-13_18:24:55.424391) 18:24:56.218483 run osmo-nitb_10.42.42.2(pid=16785): stderr: | (launched: 2022-12-13_18:24:55.474200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:56.378111 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=16785): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16785) [trial-2392↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16785)] [trial-2392↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 18:24:56.387469 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 18:24:56.394608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16784): Terminating (SIGTERM) 18:24:56.606305 --- ParallelTerminationStrategy: PID 16784 died... 18:24:56.628345 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16784): Terminated: ok {rc=0} 18:24:56.719179 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:24:57.805777 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:57.817303 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:24:57.853082 tst esme_ms_sms_transaction.py: using LAC 35428 18:24:57.976870 tst esme_ms_sms_transaction.py: using RAC 238 18:24:58.100439 tst esme_ms_sms_transaction.py: using CellId 35428 18:24:58.222930 tst esme_ms_sms_transaction.py: using BVCI 35429 18:24:58.337820 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:24:58.473754 tst esme_ms_sms_transaction.py: using MSISDN 8267 18:24:58.595583 tst esme_ms_sms_transaction.py:18: start nitb and bts... 18:24:58.823176 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:59.500347 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16786): Launched 18:24:59.835401 run osmo-nitb_10.42.42.2(pid=16787): Launched 18:25:00.020900 run osmo-nitb_10.42.42.2(pid=16787): ERR: Terminated: ERROR {rc=2} [trial-2392↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16787)] 18:25:00.169749 run osmo-nitb_10.42.42.2(pid=16787): stdout: | (launched: 2022-12-13_18:24:59.774346) 18:25:00.319824 run osmo-nitb_10.42.42.2(pid=16787): stderr: | (launched: 2022-12-13_18:24:59.823566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:25:00.470128 run osmo-nitb_10.42.42.2(pid=16787): stdout: | (launched: 2022-12-13_18:24:59.774346) 18:25:00.614224 run osmo-nitb_10.42.42.2(pid=16787): stderr: | (launched: 2022-12-13_18:24:59.823566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fcdcd86b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16787) [trial-2392↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16787)] 18:25:00.962823 tst osmo-nitb_10.42.42.2(pid=16787): stdout: | (launched: 2022-12-13_18:24:59.774346) 18:25:01.114271 tst osmo-nitb_10.42.42.2(pid=16787): stderr: | (launched: 2022-12-13_18:24:59.823566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:25:01.272443 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=16787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16787) [trial-2392↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16787)] [trial-2392↪nitb_smpp↪esme_ms_sms_transaction.py:21] 18:25:01.282369 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 18:25:01.290127 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16786): Terminating (SIGTERM) 18:25:01.503245 --- ParallelTerminationStrategy: PID 16786 died... 18:25:01.529346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16786): Terminated: ok {rc=0} 18:25:01.650596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 smpp --------------------------------------------------------------------- 18:25:02.817220 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:25:02.820315 tst smpp: Verifying 1 x bts (candidates: 11) 18:25:02.841543 tst smpp: Verifying 6 x ip_address (candidates: 9) 18:25:02.869791 tst smpp: Verifying 1 x modem (candidates: 12) 18:25:02.905402 tst smpp: Reserving 1 x bts (candidates: 11) 18:25:02.926500 tst smpp: Reserving 6 x ip_address (candidates: 9) 18:25:02.953458 tst smpp: Reserving 1 x modem (candidates: 12) 18:25:03.479441 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:25:03.484644 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:03.495164 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:03.505636 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:03.515838 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:03.535686 tst esme_connect_policy_acceptall.py: using MSISDN 8268 18:25:03.650944 run osmo-stp_10.42.42.4: Starting osmo-stp 18:25:04.184113 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16794): Launched 18:25:04.496736 run osmo-stp_10.42.42.4(pid=16795): Launched 18:25:04.616177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:05.100897 run create_hlr_db(pid=16796): Launched 18:25:05.228410 bus /sierra_2: Setting Powered False 18:25:06.290460 run create_hlr_db(pid=16796): Terminated: ok {rc=0} 18:25:06.747217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16798): Launched 18:25:07.081525 run osmo-hlr_10.42.42.2(pid=16799): Launched 18:25:07.208888 run osmo-msc_10.42.42.5: Starting osmo-msc 18:25:07.816067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16801): Launched 18:25:08.151650 run osmo-msc_10.42.42.5(pid=16802): Launched 18:25:08.339026 run osmo-hlr_10.42.42.2(pid=16799): ERR: Terminated: ERROR {rc=237} [trial-2392↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16799)] 18:25:08.488138 run osmo-hlr_10.42.42.2(pid=16799): stdout: | (launched: 2022-12-13_18:25:07.020119) 18:25:08.629785 run osmo-hlr_10.42.42.2(pid=16799): stderr: | [0;m[1;31m20221213182507214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182507227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:08.771537 run osmo-hlr_10.42.42.2(pid=16799): stdout: | (launched: 2022-12-13_18:25:07.020119) 18:25:08.905531 run osmo-hlr_10.42.42.2(pid=16799): stderr: | [0;m[1;31m20221213182507214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182507215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182507227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182507237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:09.065293 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=16799): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16799) [trial-2392↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16799)] [trial-2392↪smpp↪esme_connect_policy_acceptall.py:23] 18:25:09.074418 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 18:25:09.102378 run osmo-msc_10.42.42.5(pid=16802): ERR: Terminated: ERROR {rc=9} [trial-2392↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16802)] 18:25:09.154232 run osmo-msc_10.42.42.5(pid=16802): stdout: | (launched: 2022-12-13_18:25:08.090042) 18:25:09.208027 run osmo-msc_10.42.42.5(pid=16802): stderr: | [0;m[38;5;43m20221213182508488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221213182508488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221213182508488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221213182508488 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221213182508488 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221213182508488 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221213182508489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221213182508489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213182508489 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:25:09.261485 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16794): Terminating (SIGTERM) 18:25:09.304014 run osmo-stp_10.42.42.4(pid=16795): Terminating (SIGTERM) 18:25:09.347359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16798): Terminating (SIGTERM) 18:25:09.392583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16801): Terminating (SIGTERM) 18:25:09.439371 --- ParallelTerminationStrategy: PID 16794 died... 18:25:09.461556 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16794): Terminated: ok {rc=0} 18:25:09.510396 --- ParallelTerminationStrategy: PID 16795 died... 18:25:09.531143 run osmo-stp_10.42.42.4(pid=16795): Terminated: ok {rc=0} 18:25:09.578427 --- ParallelTerminationStrategy: PID 16798 died... 18:25:09.598589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16798): Terminated: ok {rc=0} 18:25:09.645998 --- ParallelTerminationStrategy: PID 16801 died... 18:25:09.666268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16801): Terminated: ok {rc=0} ---------------------------------------------- trial-2392 smpp esme_connect_policy_closed.py ---------------------------------------------- 18:25:09.719290 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:09.730993 tst smpp: Using 1 x bts (candidates: 1) 18:25:09.770032 tst esme_connect_policy_closed.py: using LAC 35429 18:25:09.902991 tst esme_connect_policy_closed.py: using RAC 239 18:25:10.032201 tst esme_connect_policy_closed.py: using CellId 35429 18:25:10.161750 tst esme_connect_policy_closed.py: using BVCI 35430 18:25:10.284359 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:10.295558 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:10.306511 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:10.325388 tst esme_connect_policy_closed.py: using MSISDN 8269 18:25:10.457330 tst esme_connect_policy_closed.py: using MSISDN 8270 18:25:10.580092 run osmo-stp_10.42.42.4: Starting osmo-stp 18:25:11.151168 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16805): Launched 18:25:11.486996 run osmo-stp_10.42.42.4(pid=16806): Launched 18:25:11.616761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:12.137634 run create_hlr_db(pid=16807): Launched 18:25:13.326716 run create_hlr_db(pid=16807): Terminated: ok {rc=0} 18:25:13.681220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16809): Launched 18:25:14.018113 run osmo-hlr_10.42.42.2(pid=16810): Launched 18:25:14.147522 run osmo-msc_10.42.42.5: Starting osmo-msc 18:25:14.761636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16812): Launched 18:25:15.099914 run osmo-msc_10.42.42.5(pid=16813): Launched 18:25:15.287882 run osmo-hlr_10.42.42.2(pid=16810): ERR: Terminated: ERROR {rc=237} [trial-2392↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16810)] 18:25:15.428618 run osmo-hlr_10.42.42.2(pid=16810): stdout: | (launched: 2022-12-13_18:25:13.956078) 18:25:15.575674 run osmo-hlr_10.42.42.2(pid=16810): stderr: | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182514164 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:15.715523 run osmo-hlr_10.42.42.2(pid=16810): stdout: | (launched: 2022-12-13_18:25:13.956078) 18:25:15.869376 run osmo-hlr_10.42.42.2(pid=16810): stderr: | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182514151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182514164 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182514173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:16.036465 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=16810): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16810) [trial-2392↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16810)] [trial-2392↪smpp↪esme_connect_policy_closed.py:31] 18:25:16.046764 tst esme_connect_policy_closed.py:31: Test FAILED (6.3 sec) 18:25:16.075762 run osmo-msc_10.42.42.5(pid=16813): ERR: Terminated: ERROR {rc=9} [trial-2392↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16813)] 18:25:16.130988 run osmo-msc_10.42.42.5(pid=16813): stdout: | (launched: 2022-12-13_18:25:15.037675) 18:25:16.186265 run osmo-msc_10.42.42.5(pid=16813): stderr: | [0;m[38;5;43m20221213182515409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221213182515409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221213182515409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221213182515409 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221213182515409 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221213182515410 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221213182515410 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221213182515410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213182515410 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:25:16.242136 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16805): Terminating (SIGTERM) 18:25:16.286256 run osmo-stp_10.42.42.4(pid=16806): Terminating (SIGTERM) 18:25:16.331004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16809): Terminating (SIGTERM) 18:25:16.408257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16812): Terminating (SIGTERM) 18:25:16.497298 --- ParallelTerminationStrategy: PID 16805 died... 18:25:16.518636 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16805): Terminated: ok {rc=0} 18:25:16.569614 --- ParallelTerminationStrategy: PID 16806 died... 18:25:16.590626 run osmo-stp_10.42.42.4(pid=16806): Terminated: ok {rc=0} 18:25:16.639392 --- ParallelTerminationStrategy: PID 16809 died... 18:25:16.660698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16809): Terminated: ok {rc=0} 18:25:16.710743 --- ParallelTerminationStrategy: PID 16812 died... 18:25:16.731797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16812): Terminated: ok {rc=0} ---------------------------------------------- trial-2392 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:25:16.787139 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:16.799856 tst smpp: Using 1 x bts (candidates: 1) 18:25:16.838773 tst esme_ms_sms_storeforward.py: using LAC 35430 18:25:16.967849 tst esme_ms_sms_storeforward.py: using RAC 240 18:25:17.137424 tst esme_ms_sms_storeforward.py: using CellId 35430 18:25:17.278233 tst esme_ms_sms_storeforward.py: using BVCI 35431 18:25:17.402062 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:17.413272 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:17.424133 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:17.435074 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:17.446232 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:17.457594 tst smpp: Using 1 x modem (candidates: 1) 18:25:17.586903 tst esme_ms_sms_storeforward.py: using MSISDN 8271 18:25:17.702388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:18.189290 run create_hlr_db(pid=16816): Launched 18:25:19.373646 run create_hlr_db(pid=16816): Terminated: ok {rc=0} 18:25:19.705691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16818): Launched 18:25:20.022910 run osmo-hlr_10.42.42.2(pid=16819): Launched 18:25:20.144123 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:20.689553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16821): Launched 18:25:21.006780 run osmo-stp_10.42.42.5(pid=16822): Launched 18:25:21.129051 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:21.699331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16824): Launched 18:25:22.016397 run osmo-msc_10.42.42.6(pid=16825): Launched 18:25:22.191735 run osmo-stp_10.42.42.5(pid=16822): ERR: Terminated: ERROR {rc=1} [trial-2392↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16822)] 18:25:22.325357 run osmo-stp_10.42.42.5(pid=16822): stdout: | (launched: 2022-12-13_18:25:20.947654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:22.458816 run osmo-stp_10.42.42.5(pid=16822): stderr: | [0;m[38;5;43m20221213182521119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182521119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182521120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182521120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182521120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182521121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182521121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:22.589431 run osmo-stp_10.42.42.5(pid=16822): stdout: | (launched: 2022-12-13_18:25:20.947654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:22.714692 run osmo-stp_10.42.42.5(pid=16822): stderr: | [0;m[38;5;43m20221213182521119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182521119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182521120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182521120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182521120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182521121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182521121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:22.865146 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=16822): Process ended prematurely: osmo-stp_10.42.42.5(pid=16822) [trial-2392↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16822)] [trial-2392↪smpp↪esme_ms_sms_storeforward.py:30] 18:25:22.873784 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 18:25:22.900116 run osmo-hlr_10.42.42.2(pid=16819): ERR: Terminated: ERROR {rc=237} [trial-2392↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16819)] 18:25:22.948645 run osmo-hlr_10.42.42.2(pid=16819): stdout: | (launched: 2022-12-13_18:25:19.964227) 18:25:22.998623 run osmo-hlr_10.42.42.2(pid=16819): stderr: | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182520142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182520154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182520163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182520163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182520163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:23.068709 run osmo-msc_10.42.42.6(pid=16825): ERR: Terminated: ERROR {rc=2} [trial-2392↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16825)] 18:25:23.117269 run osmo-msc_10.42.42.6(pid=16825): stdout: | (launched: 2022-12-13_18:25:21.957849) 18:25:23.167307 run osmo-msc_10.42.42.6(pid=16825): stderr: | [0;m[38;5;43m20221213182522233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182522233 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff249e70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182522233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182522233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182522234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182522234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182522236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182522236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182522236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182522236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:23.217841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16818): Terminating (SIGTERM) 18:25:23.258570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16821): Terminating (SIGTERM) 18:25:23.299129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16824): Terminating (SIGTERM) 18:25:23.339892 --- ParallelTerminationStrategy: PID 16818 died... 18:25:23.359486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16818): Terminated: ok {rc=0} 18:25:23.404288 --- ParallelTerminationStrategy: PID 16821 died... 18:25:23.423405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16821): Terminated: ok {rc=0} 18:25:23.467874 --- ParallelTerminationStrategy: PID 16824 died... 18:25:23.486923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16824): Terminated: ok {rc=0} 18:25:23.574401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:25:24.665031 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:24.677295 tst smpp: Using 1 x bts (candidates: 1) 18:25:24.715022 tst esme_ms_sms_transaction.py: using LAC 35431 18:25:24.839833 tst esme_ms_sms_transaction.py: using RAC 241 18:25:24.971792 tst esme_ms_sms_transaction.py: using CellId 35431 18:25:25.105246 tst esme_ms_sms_transaction.py: using BVCI 35432 18:25:25.227492 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:25.238690 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:25.249763 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:25.260724 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:25.272194 tst smpp: Using 1 x ip_address (candidates: 6) 18:25:25.283417 tst smpp: Using 1 x modem (candidates: 1) 18:25:25.411497 tst esme_ms_sms_transaction.py: using MSISDN 8272 18:25:25.526354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:26.012339 run create_hlr_db(pid=16827): Launched 18:25:26.141509 bus /sierra_2: Setting Powered False 18:25:27.203103 run create_hlr_db(pid=16827): Terminated: ok {rc=0} 18:25:27.661460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16829): Launched 18:25:28.000507 run osmo-hlr_10.42.42.2(pid=16830): Launched 18:25:28.130311 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:28.707871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16832): Launched 18:25:29.042726 run osmo-stp_10.42.42.5(pid=16833): Launched 18:25:29.172051 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:29.777708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16835): Launched 18:25:30.115349 run osmo-msc_10.42.42.6(pid=16836): Launched 18:25:30.303486 run osmo-stp_10.42.42.5(pid=16833): ERR: Terminated: ERROR {rc=1} [trial-2392↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16833)] 18:25:30.444486 run osmo-stp_10.42.42.5(pid=16833): stdout: | (launched: 2022-12-13_18:25:28.980759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:30.585774 run osmo-stp_10.42.42.5(pid=16833): stderr: | [0;m[38;5;43m20221213182529176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182529177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182529177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182529177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:30.726068 run osmo-stp_10.42.42.5(pid=16833): stdout: | (launched: 2022-12-13_18:25:28.980759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:30.861051 run osmo-stp_10.42.42.5(pid=16833): stderr: | [0;m[38;5;43m20221213182529176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182529177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182529177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182529177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182529178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:31.059099 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=16833): Process ended prematurely: osmo-stp_10.42.42.5(pid=16833) [trial-2392↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16833)] [trial-2392↪smpp↪esme_ms_sms_transaction.py:28] 18:25:31.071760 tst esme_ms_sms_transaction.py:28: Test FAILED (6.4 sec) 18:25:31.100709 run osmo-hlr_10.42.42.2(pid=16830): ERR: Terminated: ERROR {rc=237} [trial-2392↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16830)] 18:25:31.155298 run osmo-hlr_10.42.42.2(pid=16830): stdout: | (launched: 2022-12-13_18:25:27.938095) 18:25:31.214363 run osmo-hlr_10.42.42.2(pid=16830): stderr: | [0;m[1;31m20221213182528138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182528138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182528138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182528138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182528139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182528139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182528151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182528161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182528161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182528161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:31.300548 run osmo-msc_10.42.42.6(pid=16836): ERR: Terminated: ERROR {rc=2} [trial-2392↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16836)] 18:25:31.359590 run osmo-msc_10.42.42.6(pid=16836): stdout: | (launched: 2022-12-13_18:25:30.053260) 18:25:31.414377 run osmo-msc_10.42.42.6(pid=16836): stderr: | [0;m[38;5;43m20221213182530379 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182530379 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdef22e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182530380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182530380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182530380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182530380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182530382 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182530382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182530383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182530383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:31.469547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16829): Terminating (SIGTERM) 18:25:31.513851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16832): Terminating (SIGTERM) 18:25:31.559956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16835): Terminating (SIGTERM) 18:25:31.605078 --- ParallelTerminationStrategy: PID 16829 died... 18:25:31.627075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16829): Terminated: ok {rc=0} 18:25:31.676218 --- ParallelTerminationStrategy: PID 16832 died... 18:25:31.698010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16832): Terminated: ok {rc=0} 18:25:31.747086 --- ParallelTerminationStrategy: PID 16835 died... 18:25:31.768396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16835): Terminated: ok {rc=0} 18:25:31.861555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 encryption --------------------------------------------------------------------- 18:25:33.057612 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:25:33.061218 tst encryption: Verifying 1 x bts (candidates: 11) 18:25:33.083272 tst encryption: Verifying 6 x ip_address (candidates: 9) 18:25:33.112023 tst encryption: Verifying 1 x modem (candidates: 12) 18:25:33.150045 tst encryption: Reserving 1 x bts (candidates: 11) 18:25:33.172866 tst encryption: Reserving 6 x ip_address (candidates: 9) 18:25:33.200774 tst encryption: Reserving 1 x modem (candidates: 12) 18:25:33.727360 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2392 encryption register_a5_0_authopt.py ---------------------------------------------- 18:25:33.784028 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:33.795270 tst encryption: Using 1 x bts (candidates: 1) 18:25:33.834970 tst register_a5_0_authopt.py: using LAC 35432 18:25:33.960546 tst register_a5_0_authopt.py: using RAC 242 18:25:34.094800 tst register_a5_0_authopt.py: using CellId 35432 18:25:34.227958 tst register_a5_0_authopt.py: using BVCI 35433 18:25:34.351889 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:34.363081 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:34.374234 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:34.385406 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:34.396633 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:34.407842 tst encryption: Using 1 x modem (candidates: 1) 18:25:34.530401 tst register_a5_0_authopt.py:8: start network... 18:25:34.745360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:35.237233 run create_hlr_db(pid=16841): Launched 18:25:35.367109 bus /sierra_2: Setting Powered False 18:25:36.430569 run create_hlr_db(pid=16841): Terminated: ok {rc=0} 18:25:36.895101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16843): Launched 18:25:37.236236 run osmo-hlr_10.42.42.2(pid=16844): Launched 18:25:37.367821 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:37.955952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16846): Launched 18:25:38.295524 run osmo-stp_10.42.42.5(pid=16847): Launched 18:25:38.426652 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:39.036925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16849): Launched 18:25:39.378802 run osmo-msc_10.42.42.6(pid=16850): Launched 18:25:39.567601 run osmo-stp_10.42.42.5(pid=16847): ERR: Terminated: ERROR {rc=1} [trial-2392↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16847)] 18:25:39.710429 run osmo-stp_10.42.42.5(pid=16847): stdout: | (launched: 2022-12-13_18:25:38.232931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:39.853468 run osmo-stp_10.42.42.5(pid=16847): stderr: | [0;m[38;5;43m20221213182538429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182538429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182538430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182538430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:39.994829 run osmo-stp_10.42.42.5(pid=16847): stdout: | (launched: 2022-12-13_18:25:38.232931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:40.120898 run osmo-stp_10.42.42.5(pid=16847): stderr: | [0;m[38;5;43m20221213182538429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182538429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182538430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182538430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182538431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:40.272126 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16847): Process ended prematurely: osmo-stp_10.42.42.5(pid=16847) [trial-2392↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16847)] [trial-2392↪encryption↪register_a5_0_authopt.py:8] 18:25:40.281500 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 18:25:40.308318 run osmo-hlr_10.42.42.2(pid=16844): ERR: Terminated: ERROR {rc=237} [trial-2392↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16844)] 18:25:40.357540 run osmo-hlr_10.42.42.2(pid=16844): stdout: | (launched: 2022-12-13_18:25:37.173857) 18:25:40.408312 run osmo-hlr_10.42.42.2(pid=16844): stderr: | [0;m[1;31m20221213182537375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182537375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182537375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182537375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182537375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182537376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182537388 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182537396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182537396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182537396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:40.479945 run osmo-msc_10.42.42.6(pid=16850): ERR: Terminated: ERROR {rc=2} [trial-2392↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16850)] 18:25:40.528756 run osmo-msc_10.42.42.6(pid=16850): stdout: | (launched: 2022-12-13_18:25:39.316026) 18:25:40.579414 run osmo-msc_10.42.42.6(pid=16850): stderr: | [0;m[38;5;43m20221213182539641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182539641 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e3b16cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182539641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182539641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182539641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182539642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182539643 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182539644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182539644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182539644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:40.630064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16843): Terminating (SIGTERM) 18:25:40.670559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16846): Terminating (SIGTERM) 18:25:40.711268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16849): Terminating (SIGTERM) 18:25:40.752273 --- ParallelTerminationStrategy: PID 16843 died... 18:25:40.772108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16843): Terminated: ok {rc=0} 18:25:40.817373 --- ParallelTerminationStrategy: PID 16846 died... 18:25:40.836538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16846): Terminated: ok {rc=0} 18:25:40.881552 --- ParallelTerminationStrategy: PID 16849 died... 18:25:40.900804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16849): Terminated: ok {rc=0} 18:25:40.988154 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 encryption register_a5_0_authreq.py ---------------------------------------------- 18:25:42.144216 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.156339 tst encryption: Using 1 x bts (candidates: 1) 18:25:42.200466 tst register_a5_0_authreq.py: using LAC 35433 18:25:42.324233 tst register_a5_0_authreq.py: using RAC 243 18:25:42.447974 tst register_a5_0_authreq.py: using CellId 35433 18:25:42.580928 tst register_a5_0_authreq.py: using BVCI 35434 18:25:42.705158 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.716238 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.727143 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.738355 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.749763 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:42.760943 tst encryption: Using 1 x modem (candidates: 1) 18:25:42.883272 tst register_a5_0_authreq.py:8: start network... 18:25:43.097404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:43.587405 run create_hlr_db(pid=16852): Launched 18:25:43.718944 bus /sierra_2: Setting Powered False 18:25:44.782156 run create_hlr_db(pid=16852): Terminated: ok {rc=0} 18:25:45.245684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16854): Launched 18:25:45.588154 run osmo-hlr_10.42.42.2(pid=16855): Launched 18:25:45.720135 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:46.365874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16857): Launched 18:25:46.724788 run osmo-stp_10.42.42.5(pid=16858): Launched 18:25:47.062093 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:47.644331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16860): Launched 18:25:47.966081 run osmo-msc_10.42.42.6(pid=16861): Launched 18:25:48.145512 run osmo-stp_10.42.42.5(pid=16858): ERR: Terminated: ERROR {rc=1} [trial-2392↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] 18:25:48.279951 run osmo-stp_10.42.42.5(pid=16858): stdout: | (launched: 2022-12-13_18:25:46.658507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:48.412881 run osmo-stp_10.42.42.5(pid=16858): stderr: | [0;m[38;5;43m20221213182546920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182546921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182546922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182546923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182546924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182546925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182546925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:48.545921 run osmo-stp_10.42.42.5(pid=16858): stdout: | (launched: 2022-12-13_18:25:46.658507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:48.672194 run osmo-stp_10.42.42.5(pid=16858): stderr: | [0;m[38;5;43m20221213182546920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182546921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182546922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182546923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182546924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182546925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182546925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:48.823519 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16858): Process ended prematurely: osmo-stp_10.42.42.5(pid=16858) [trial-2392↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] [trial-2392↪encryption↪register_a5_0_authreq.py:8] 18:25:48.832733 tst register_a5_0_authreq.py:8: Test FAILED (6.7 sec) 18:25:48.859531 run osmo-hlr_10.42.42.2(pid=16855): ERR: Terminated: ERROR {rc=237} [trial-2392↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16855)] 18:25:48.908004 run osmo-hlr_10.42.42.2(pid=16855): stdout: | (launched: 2022-12-13_18:25:45.525270) 18:25:48.957888 run osmo-hlr_10.42.42.2(pid=16855): stderr: | [0;m[1;31m20221213182545725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182545725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182545726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182545726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182545726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182545726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182545738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182545746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182545747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182545747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:49.027945 run osmo-msc_10.42.42.6(pid=16861): ERR: Terminated: ERROR {rc=2} [trial-2392↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16861)] 18:25:49.076122 run osmo-msc_10.42.42.6(pid=16861): stdout: | (launched: 2022-12-13_18:25:47.906485) 18:25:49.125961 run osmo-msc_10.42.42.6(pid=16861): stderr: | [0;m[38;5;43m20221213182548182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182548182 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f754bb68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182548182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182548182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182548182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182548182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182548184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182548185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182548185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182548185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:49.176049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16854): Terminating (SIGTERM) 18:25:49.216293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16857): Terminating (SIGTERM) 18:25:49.256775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16860): Terminating (SIGTERM) 18:25:49.297664 --- ParallelTerminationStrategy: PID 16854 died... 18:25:49.317305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16854): Terminated: ok {rc=0} 18:25:49.362280 --- ParallelTerminationStrategy: PID 16857 died... 18:25:49.381338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16857): Terminated: ok {rc=0} 18:25:49.425891 --- ParallelTerminationStrategy: PID 16860 died... 18:25:49.445041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16860): Terminated: ok {rc=0} 18:25:49.532822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 encryption register_a5_1_authreq.py ---------------------------------------------- 18:25:50.684677 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:50.696295 tst encryption: Using 1 x bts (candidates: 1) 18:25:50.733121 tst register_a5_1_authreq.py: using LAC 35434 18:25:50.860163 tst register_a5_1_authreq.py: using RAC 244 18:25:50.986341 tst register_a5_1_authreq.py: using CellId 35434 18:25:51.112065 tst register_a5_1_authreq.py: using BVCI 35435 18:25:51.229377 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:51.239841 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:51.250405 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:51.260737 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:51.271113 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:51.281969 tst encryption: Using 1 x modem (candidates: 1) 18:25:51.405486 tst register_a5_1_authreq.py:8: start network... 18:25:51.637370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:52.150067 run create_hlr_db(pid=16866): Launched 18:25:52.281784 bus /sierra_2: Setting Powered False 18:25:53.345200 run create_hlr_db(pid=16866): Terminated: ok {rc=0} 18:25:53.810219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Launched 18:25:54.151988 run osmo-hlr_10.42.42.2(pid=16869): Launched 18:25:54.284052 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:54.871688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Launched 18:25:55.214037 run osmo-stp_10.42.42.5(pid=16872): Launched 18:25:55.346493 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:55.958925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16874): Launched 18:25:56.300859 run osmo-msc_10.42.42.6(pid=16875): Launched 18:25:56.493082 run osmo-stp_10.42.42.5(pid=16872): ERR: Terminated: ERROR {rc=1} [trial-2392↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] 18:25:56.636133 run osmo-stp_10.42.42.5(pid=16872): stdout: | (launched: 2022-12-13_18:25:55.150730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:56.780656 run osmo-stp_10.42.42.5(pid=16872): stderr: | [0;m[38;5;43m20221213182555345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182555345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182555346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182555346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:56.921899 run osmo-stp_10.42.42.5(pid=16872): stdout: | (launched: 2022-12-13_18:25:55.150730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:57.057046 run osmo-stp_10.42.42.5(pid=16872): stderr: | [0;m[38;5;43m20221213182555345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182555345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182555346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182555346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182555347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:57.218930 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16872): Process ended prematurely: osmo-stp_10.42.42.5(pid=16872) [trial-2392↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] [trial-2392↪encryption↪register_a5_1_authreq.py:8] 18:25:57.228629 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 18:25:57.256881 run osmo-hlr_10.42.42.2(pid=16869): ERR: Terminated: ERROR {rc=237} [trial-2392↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16869)] 18:25:57.308250 run osmo-hlr_10.42.42.2(pid=16869): stdout: | (launched: 2022-12-13_18:25:54.089208) 18:25:57.361359 run osmo-hlr_10.42.42.2(pid=16869): stderr: | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182554291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182554307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182554317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182554318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182554318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:57.435091 run osmo-msc_10.42.42.6(pid=16875): ERR: Terminated: ERROR {rc=2} [trial-2392↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16875)] 18:25:57.485860 run osmo-msc_10.42.42.6(pid=16875): stdout: | (launched: 2022-12-13_18:25:56.238153) 18:25:57.538851 run osmo-msc_10.42.42.6(pid=16875): stderr: | [0;m[38;5;43m20221213182556565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182556565 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f439d961c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182556565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182556565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182556565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182556566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182556567 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182556568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182556568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182556568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:57.592137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Terminating (SIGTERM) 18:25:57.634626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Terminating (SIGTERM) 18:25:57.677872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16874): Terminating (SIGTERM) 18:25:57.721226 --- ParallelTerminationStrategy: PID 16868 died... 18:25:57.741835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Terminated: ok {rc=0} 18:25:57.789158 --- ParallelTerminationStrategy: PID 16871 died... 18:25:57.809348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Terminated: ok {rc=0} 18:25:57.856511 --- ParallelTerminationStrategy: PID 16874 died... 18:25:57.876791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16874): Terminated: ok {rc=0} 18:25:57.967026 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2392 encryption register_a5_3_authreq.py ---------------------------------------------- 18:25:59.122586 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.134469 tst encryption: Using 1 x bts (candidates: 1) 18:25:59.172112 tst register_a5_3_authreq.py: using LAC 35435 18:25:59.298487 tst register_a5_3_authreq.py: using RAC 245 18:25:59.425190 tst register_a5_3_authreq.py: using CellId 35435 18:25:59.550413 tst register_a5_3_authreq.py: using BVCI 35436 18:25:59.667767 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.678539 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.689179 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.699513 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.709891 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:59.720133 tst encryption: Using 1 x modem (candidates: 1) 18:25:59.854942 tst register_a5_3_authreq.py:8: start network... 18:26:00.086102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:00.609565 run create_hlr_db(pid=16877): Launched 18:26:00.742410 bus /sierra_2: Setting Powered False 18:26:01.823744 run create_hlr_db(pid=16877): Terminated: ok {rc=0} 18:26:02.340937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16879): Launched 18:26:02.683246 run osmo-hlr_10.42.42.2(pid=16880): Launched 18:26:02.815379 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:03.398148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16882): Launched 18:26:03.739991 run osmo-stp_10.42.42.5(pid=16883): Launched 18:26:03.872261 run osmo-msc_10.42.42.6: Starting osmo-msc 18:26:04.485418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16885): Launched 18:26:04.829432 run osmo-msc_10.42.42.6(pid=16886): Launched 18:26:05.020923 run osmo-stp_10.42.42.5(pid=16883): ERR: Terminated: ERROR {rc=1} [trial-2392↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16883)] 18:26:05.164182 run osmo-stp_10.42.42.5(pid=16883): stdout: | (launched: 2022-12-13_18:26:03.677246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:05.308366 run osmo-stp_10.42.42.5(pid=16883): stderr: | [0;m[38;5;43m20221213182603872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182603872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182603873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182603873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:05.450132 run osmo-stp_10.42.42.5(pid=16883): stdout: | (launched: 2022-12-13_18:26:03.677246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:05.585568 run osmo-stp_10.42.42.5(pid=16883): stderr: | [0;m[38;5;43m20221213182603872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182603872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182603873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182603873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182603874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:05.748307 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16883): Process ended prematurely: osmo-stp_10.42.42.5(pid=16883) [trial-2392↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16883)] [trial-2392↪encryption↪register_a5_3_authreq.py:8] 18:26:05.758100 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 18:26:05.785965 run osmo-hlr_10.42.42.2(pid=16880): ERR: Terminated: ERROR {rc=237} [trial-2392↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16880)] 18:26:05.837253 run osmo-hlr_10.42.42.2(pid=16880): stdout: | (launched: 2022-12-13_18:26:02.620379) 18:26:05.890383 run osmo-hlr_10.42.42.2(pid=16880): stderr: | [0;m[1;31m20221213182602822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182602822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182602822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182602822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182602823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182602823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182602834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182602842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182602842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182602842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:26:05.963780 run osmo-msc_10.42.42.6(pid=16886): ERR: Terminated: ERROR {rc=2} [trial-2392↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16886)] 18:26:06.014513 run osmo-msc_10.42.42.6(pid=16886): stdout: | (launched: 2022-12-13_18:26:04.766484) 18:26:06.067382 run osmo-msc_10.42.42.6(pid=16886): stderr: | [0;m[38;5;43m20221213182605093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182605093 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff16039ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182605093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182605093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182605094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182605094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182605095 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182605096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182605096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182605096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:26:06.120261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16879): Terminating (SIGTERM) 18:26:06.162809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16882): Terminating (SIGTERM) 18:26:06.206198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16885): Terminating (SIGTERM) 18:26:06.249436 --- ParallelTerminationStrategy: PID 16879 died... 18:26:06.270224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16879): Terminated: ok {rc=0} 18:26:06.317620 --- ParallelTerminationStrategy: PID 16882 died... 18:26:06.337931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16882): Terminated: ok {rc=0} 18:26:06.385165 --- ParallelTerminationStrategy: PID 16885 died... 18:26:06.405369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16885): Terminated: ok {rc=0} 18:26:06.494403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 18:26:07.705585 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:07.710853 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 18:26:07.729609 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 18:26:07.760045 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 18:26:07.789200 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 18:26:07.807680 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 18:26:07.834080 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 18:26:08.345235 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 18:26:08.350077 tst handover.py:11: TEST_CONFIG: {} 18:26:08.562553 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:08.578535 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:08.601580 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:08.652296 tst handover.py: using MSISDN 8273 18:26:08.769874 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8273', subscriber_id=0} 18:26:08.879971 run srsepc_10.42.42.118: Starting srsepc 18:26:10.756189 run rm-remote-dir(pid=16891): Launched 18:26:10.884458 bus /sierra_2: Setting Powered False 18:26:11.950754 run rm-remote-dir(pid=16891): Terminated: ok {rc=0} 18:26:12.426385 run mk-remote-dir(pid=16892): Launched 18:26:13.618703 run mk-remote-dir(pid=16892): Terminated: ok {rc=0} 18:26:13.915263 run scp-inst-to-remote(pid=16893): Launched 18:26:16.103541 run scp-inst-to-remote(pid=16893): Terminated: ok {rc=0} 18:26:16.480482 run rm-remote-dir(pid=16895): Launched 18:26:17.743749 run rm-remote-dir(pid=16895): Terminated: ok {rc=0} 18:26:18.114148 run mk-remote-dir(pid=16896): Launched 18:26:19.313095 run mk-remote-dir(pid=16896): Terminated: ok {rc=0} 18:26:19.628629 run scp-cfg-to-remote(pid=16897): Launched 18:26:20.824838 run scp-cfg-to-remote(pid=16897): Terminated: ok {rc=0} 18:26:21.139019 run scp-db-to-remote(pid=16899): Launched 18:26:22.334438 run scp-db-to-remote(pid=16899): Terminated: ok {rc=0} 18:26:22.479736 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:26:22.820707 run patchelf(pid=16901): Launched 18:26:24.015376 run patchelf(pid=16901): Terminated: ok {rc=0} 18:26:24.159678 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:26:24.500173 run setcap-netadm(pid=16902): Launched 18:26:25.694477 run setcap-netadm(pid=16902): Terminated: ok {rc=0} 18:26:26.050784 run srsepc(pid=16903): Launched 18:26:26.177361 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:26:27.388774 run rm-remote-dir(pid=16904): Launched 18:26:27.585846 run srsepc(pid=16903): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16903)] 18:26:27.734149 run srsepc(pid=16903): stdout: | (launched: 2022-12-13_18:26:25.988241) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:27.882689 run srsepc(pid=16903): stderr: | (launched: 2022-12-13_18:26:26.038355) | Connection to 10.42.42.116 closed. 18:26:28.031563 run srsepc(pid=16903): stdout: | (launched: 2022-12-13_18:26:25.988241) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:28.173895 run srsepc(pid=16903): stderr: | (launched: 2022-12-13_18:26:26.038355) | Connection to 10.42.42.116 closed. 18:26:28.343533 run rm-remote-dir(pid=16904): Terminating (SIGINT) 18:26:28.540794 run rm-remote-dir(pid=16904): Terminated: ok {rc=0} 18:26:28.682444 tst handover.py:37: ERR: Error: srsepc(pid=16903): Process ended prematurely: srsepc(pid=16903) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16903)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 18:26:28.693385 tst handover.py:37: Test FAILED (20.3 sec) 18:26:28.777776 run scp-back-log(pid=16905): Launched 18:26:29.859911 run scp-back-log(pid=16905): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16905)] 18:26:29.925205 run scp-back-log(pid=16905): stdout: | (launched: 2022-12-13_18:26:28.744117) 18:26:29.991833 run scp-back-log(pid=16905): stderr: | (launched: 2022-12-13_18:26:28.765377) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:26:30.067211 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16905): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16905)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 18:26:30.115766 tst iperf3_bidir.py:13: Number of physical ue: 1 18:26:30.345336 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:30.389088 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 18:26:30.617539 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:30.634012 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:30.666958 tst iperf3_bidir.py: using MSISDN 8274 18:26:30.786048 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8274', subscriber_id=0} 18:26:30.912741 run srsepc_10.42.42.118: Starting srsepc 18:26:31.625674 run rm-remote-dir(pid=16907): Launched 18:26:32.882204 run rm-remote-dir(pid=16907): Terminated: ok {rc=0} 18:26:33.253599 run mk-remote-dir(pid=16908): Launched 18:26:34.451682 run mk-remote-dir(pid=16908): Terminated: ok {rc=0} 18:26:34.768839 run scp-inst-to-remote(pid=16909): Launched 18:26:36.967943 run scp-inst-to-remote(pid=16909): Terminated: ok {rc=0} 18:26:37.336938 run rm-remote-dir(pid=16911): Launched 18:26:38.537212 run rm-remote-dir(pid=16911): Terminated: ok {rc=0} 18:26:38.909277 run mk-remote-dir(pid=16912): Launched 18:26:40.108490 run mk-remote-dir(pid=16912): Terminated: ok {rc=0} 18:26:40.424932 run scp-cfg-to-remote(pid=16913): Launched 18:26:41.621414 run scp-cfg-to-remote(pid=16913): Terminated: ok {rc=0} 18:26:41.936063 run scp-db-to-remote(pid=16915): Launched 18:26:43.132067 run scp-db-to-remote(pid=16915): Terminated: ok {rc=0} 18:26:43.276831 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:26:43.617736 run patchelf(pid=16917): Launched 18:26:44.827972 run patchelf(pid=16917): Terminated: ok {rc=0} 18:26:44.974007 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:26:45.315840 run setcap-netadm(pid=16918): Launched 18:26:46.509783 run setcap-netadm(pid=16918): Terminated: ok {rc=0} 18:26:46.876711 run srsepc(pid=16919): Launched 18:26:47.058880 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:26:48.321214 run rm-remote-dir(pid=16920): Launched 18:26:48.516391 run srsepc(pid=16919): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16919)] 18:26:48.663808 run srsepc(pid=16919): stdout: | (launched: 2022-12-13_18:26:46.813996) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:48.812746 run srsepc(pid=16919): stderr: | (launched: 2022-12-13_18:26:46.865449) | Connection to 10.42.42.116 closed. 18:26:48.961161 run srsepc(pid=16919): stdout: | (launched: 2022-12-13_18:26:46.813996) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:49.103935 run srsepc(pid=16919): stderr: | (launched: 2022-12-13_18:26:46.865449) | Connection to 10.42.42.116 closed. 18:26:49.271952 run rm-remote-dir(pid=16920): Terminating (SIGINT) 18:26:49.467877 run rm-remote-dir(pid=16920): Terminated: ok {rc=0} 18:26:49.609519 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=16919): Process ended prematurely: srsepc(pid=16919) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16919)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 18:26:49.620553 tst iperf3_bidir.py:42: Test FAILED (19.5 sec) 18:26:49.704741 run scp-back-log(pid=16921): Launched 18:26:50.788634 run scp-back-log(pid=16921): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16921)] 18:26:50.854130 run scp-back-log(pid=16921): stdout: | (launched: 2022-12-13_18:26:49.671060) 18:26:50.921273 run scp-back-log(pid=16921): stderr: | (launched: 2022-12-13_18:26:49.692256) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:26:50.997071 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16921): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16921)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 18:26:51.045958 tst iperf3_dl.py:13: Number of physical ue: 1 18:26:51.276226 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:51.322056 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 18:26:51.549878 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:51.566598 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:51.599523 tst iperf3_dl.py: using MSISDN 8275 18:26:51.722899 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8275', subscriber_id=0} 18:26:51.841449 run srsepc_10.42.42.118: Starting srsepc 18:26:52.534170 run rm-remote-dir(pid=16923): Launched 18:26:53.734256 run rm-remote-dir(pid=16923): Terminated: ok {rc=0} 18:26:54.105303 run mk-remote-dir(pid=16924): Launched 18:26:55.303639 run mk-remote-dir(pid=16924): Terminated: ok {rc=0} 18:26:55.620012 run scp-inst-to-remote(pid=16925): Launched 18:26:57.817180 run scp-inst-to-remote(pid=16925): Terminated: ok {rc=0} 18:26:58.186402 run rm-remote-dir(pid=16927): Launched 18:26:59.382196 run rm-remote-dir(pid=16927): Terminated: ok {rc=0} 18:26:59.754047 run mk-remote-dir(pid=16928): Launched 18:27:00.955588 run mk-remote-dir(pid=16928): Terminated: ok {rc=0} 18:27:01.279022 run scp-cfg-to-remote(pid=16929): Launched 18:27:02.606711 run scp-cfg-to-remote(pid=16929): Terminated: ok {rc=0} 18:27:02.914710 run scp-db-to-remote(pid=16931): Launched 18:27:04.100204 run scp-db-to-remote(pid=16931): Terminated: ok {rc=0} 18:27:04.235649 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:27:04.555479 run patchelf(pid=16933): Launched 18:27:05.741467 run patchelf(pid=16933): Terminated: ok {rc=0} 18:27:05.877958 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:27:06.198132 run setcap-netadm(pid=16934): Launched 18:27:07.384210 run setcap-netadm(pid=16934): Terminated: ok {rc=0} 18:27:07.718748 run srsepc(pid=16935): Launched 18:27:07.840317 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:27:08.984023 run rm-remote-dir(pid=16936): Launched 18:27:09.169214 run srsepc(pid=16935): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16935)] 18:27:09.309230 run srsepc(pid=16935): stdout: | (launched: 2022-12-13_18:27:07.659744) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:09.448301 run srsepc(pid=16935): stderr: | (launched: 2022-12-13_18:27:07.706589) | Connection to 10.42.42.116 closed. 18:27:09.587165 run srsepc(pid=16935): stdout: | (launched: 2022-12-13_18:27:07.659744) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:09.720335 run srsepc(pid=16935): stderr: | (launched: 2022-12-13_18:27:07.706589) | Connection to 10.42.42.116 closed. 18:27:09.878278 run rm-remote-dir(pid=16936): Terminating (SIGINT) 18:27:10.062752 run rm-remote-dir(pid=16936): Terminated: ok {rc=0} 18:27:10.195869 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=16935): Process ended prematurely: srsepc(pid=16935) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16935)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 18:27:10.206387 tst iperf3_dl.py:42: Test FAILED (19.2 sec) 18:27:10.286253 run scp-back-log(pid=16937): Launched 18:27:11.367485 run scp-back-log(pid=16937): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16937)] 18:27:11.432875 run scp-back-log(pid=16937): stdout: | (launched: 2022-12-13_18:27:10.253933) 18:27:11.499771 run scp-back-log(pid=16937): stderr: | (launched: 2022-12-13_18:27:10.274024) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:27:11.575068 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16937): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16937)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 18:27:11.623477 tst iperf3_ul.py:13: Number of physical ue: 1 18:27:11.852476 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:27:11.896513 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 18:27:12.107093 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:27:12.123112 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:27:12.155393 tst iperf3_ul.py: using MSISDN 8276 18:27:12.269677 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8276', subscriber_id=0} 18:27:12.380231 run srsepc_10.42.42.118: Starting srsepc 18:27:13.031027 run rm-remote-dir(pid=16939): Launched 18:27:14.221511 run rm-remote-dir(pid=16939): Terminated: ok {rc=0} 18:27:14.570484 run mk-remote-dir(pid=16940): Launched 18:27:15.758815 run mk-remote-dir(pid=16940): Terminated: ok {rc=0} 18:27:16.097530 run scp-inst-to-remote(pid=16941): Launched 18:27:18.366451 run scp-inst-to-remote(pid=16941): Terminated: ok {rc=0} 18:27:18.735820 run rm-remote-dir(pid=16943): Launched 18:27:19.934089 run rm-remote-dir(pid=16943): Terminated: ok {rc=0} 18:27:20.305030 run mk-remote-dir(pid=16944): Launched 18:27:21.504471 run mk-remote-dir(pid=16944): Terminated: ok {rc=0} 18:27:21.821218 run scp-cfg-to-remote(pid=16945): Launched 18:27:23.017304 run scp-cfg-to-remote(pid=16945): Terminated: ok {rc=0} 18:27:23.331790 run scp-db-to-remote(pid=16947): Launched 18:27:24.529034 run scp-db-to-remote(pid=16947): Terminated: ok {rc=0} 18:27:24.673839 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:27:25.016061 run patchelf(pid=16949): Launched 18:27:26.211979 run patchelf(pid=16949): Terminated: ok {rc=0} 18:27:26.357785 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:27:26.699871 run setcap-netadm(pid=16950): Launched 18:27:27.895640 run setcap-netadm(pid=16950): Terminated: ok {rc=0} 18:27:28.254950 run srsepc(pid=16951): Launched 18:27:28.380838 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:27:29.604034 run rm-remote-dir(pid=16952): Launched 18:27:29.799709 run srsepc(pid=16951): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16951)] 18:27:29.948351 run srsepc(pid=16951): stdout: | (launched: 2022-12-13_18:27:28.191510) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:30.097925 run srsepc(pid=16951): stderr: | (launched: 2022-12-13_18:27:28.242037) | Connection to 10.42.42.116 closed. 18:27:30.248064 run srsepc(pid=16951): stdout: | (launched: 2022-12-13_18:27:28.191510) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:30.391708 run srsepc(pid=16951): stderr: | (launched: 2022-12-13_18:27:28.242037) | Connection to 10.42.42.116 closed. 18:27:30.561870 run rm-remote-dir(pid=16952): Terminating (SIGINT) 18:27:30.759594 run rm-remote-dir(pid=16952): Terminated: ok {rc=0} 18:27:30.908615 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=16951): Process ended prematurely: srsepc(pid=16951) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16951)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 18:27:30.926240 tst iperf3_ul.py:42: Test FAILED (19.3 sec) 18:27:31.013103 run scp-back-log(pid=16953): Launched 18:27:32.121539 run scp-back-log(pid=16953): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16953)] 18:27:32.187388 run scp-back-log(pid=16953): stdout: | (launched: 2022-12-13_18:27:30.978833) 18:27:32.252165 run scp-back-log(pid=16953): stderr: | (launched: 2022-12-13_18:27:31.000315) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:27:32.325296 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16953): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16953)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 18:27:32.373807 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:27:32.391453 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:27:32.414631 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:27:32.469799 tst ping.py: using MSISDN 8277 18:27:32.595885 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8277', subscriber_id=0} 18:27:32.714558 run srsepc_10.42.42.118: Starting srsepc 18:27:33.409033 run rm-remote-dir(pid=16957): Launched 18:27:34.608203 run rm-remote-dir(pid=16957): Terminated: ok {rc=0} 18:27:34.979328 run mk-remote-dir(pid=16958): Launched 18:27:36.176678 run mk-remote-dir(pid=16958): Terminated: ok {rc=0} 18:27:36.493548 run scp-inst-to-remote(pid=16959): Launched 18:27:38.691280 run scp-inst-to-remote(pid=16959): Terminated: ok {rc=0} 18:27:39.061588 run rm-remote-dir(pid=16961): Launched 18:27:40.260799 run rm-remote-dir(pid=16961): Terminated: ok {rc=0} 18:27:40.632284 run mk-remote-dir(pid=16962): Launched 18:27:41.830384 run mk-remote-dir(pid=16962): Terminated: ok {rc=0} 18:27:42.146977 run scp-cfg-to-remote(pid=16963): Launched 18:27:43.344208 run scp-cfg-to-remote(pid=16963): Terminated: ok {rc=0} 18:27:43.658415 run scp-db-to-remote(pid=16965): Launched 18:27:44.854967 run scp-db-to-remote(pid=16965): Terminated: ok {rc=0} 18:27:44.999346 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:27:45.341582 run patchelf(pid=16967): Launched 18:27:46.549459 run patchelf(pid=16967): Terminated: ok {rc=0} 18:27:46.730242 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:27:47.128898 run setcap-netadm(pid=16968): Launched 18:27:48.363245 run setcap-netadm(pid=16968): Terminated: ok {rc=0} 18:27:48.697899 run srsepc(pid=16969): Launched 18:27:48.817688 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:27:49.959822 run rm-remote-dir(pid=16970): Launched 18:27:50.140014 run srsepc(pid=16969): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16969)] 18:27:50.277552 run srsepc(pid=16969): stdout: | (launched: 2022-12-13_18:27:48.638915) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:50.413693 run srsepc(pid=16969): stderr: | (launched: 2022-12-13_18:27:48.685800) | Connection to 10.42.42.116 closed. 18:27:50.549654 run srsepc(pid=16969): stdout: | (launched: 2022-12-13_18:27:48.638915) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:50.679715 run srsepc(pid=16969): stderr: | (launched: 2022-12-13_18:27:48.685800) | Connection to 10.42.42.116 closed. 18:27:50.834636 run rm-remote-dir(pid=16970): Terminating (SIGINT) 18:27:51.014870 run rm-remote-dir(pid=16970): Terminated: ok {rc=0} 18:27:51.144892 tst ping.py:16: ERR: Error: srsepc(pid=16969): Process ended prematurely: srsepc(pid=16969) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16969)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 18:27:51.154827 tst ping.py:16: Test FAILED (18.8 sec) 18:27:51.233191 run scp-back-log(pid=16971): Launched 18:27:52.310459 run scp-back-log(pid=16971): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16971)] 18:27:52.371175 run scp-back-log(pid=16971): stdout: | (launched: 2022-12-13_18:27:51.201478) 18:27:52.433432 run scp-back-log(pid=16971): stderr: | (launched: 2022-12-13_18:27:51.221284) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:27:52.503413 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16971): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16971)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 18:27:52.549424 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:27:52.565889 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:27:52.588719 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:27:52.641667 tst rrc_idle_mo_ping.py: using MSISDN 8278 18:27:52.756767 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8278', subscriber_id=0} 18:27:52.864507 run srsepc_10.42.42.118: Starting srsepc 18:27:53.497955 run rm-remote-dir(pid=16973): Launched 18:27:54.680740 run rm-remote-dir(pid=16973): Terminated: ok {rc=0} 18:27:55.021738 run mk-remote-dir(pid=16974): Launched 18:27:56.216226 run mk-remote-dir(pid=16974): Terminated: ok {rc=0} 18:27:56.525657 run scp-inst-to-remote(pid=16975): Launched 18:27:58.717485 run scp-inst-to-remote(pid=16975): Terminated: ok {rc=0} 18:27:59.078521 run rm-remote-dir(pid=16977): Launched 18:28:00.270607 run rm-remote-dir(pid=16977): Terminated: ok {rc=0} 18:28:00.627816 run mk-remote-dir(pid=16978): Launched 18:28:01.817638 run mk-remote-dir(pid=16978): Terminated: ok {rc=0} 18:28:02.131205 run scp-cfg-to-remote(pid=16979): Launched 18:28:03.339920 run scp-cfg-to-remote(pid=16979): Terminated: ok {rc=0} 18:28:03.646604 run scp-db-to-remote(pid=16981): Launched 18:28:04.838251 run scp-db-to-remote(pid=16981): Terminated: ok {rc=0} 18:28:04.979753 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:28:05.312322 run patchelf(pid=16983): Launched 18:28:06.502339 run patchelf(pid=16983): Terminated: ok {rc=0} 18:28:06.644260 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:28:06.977289 run setcap-netadm(pid=16984): Launched 18:28:08.166824 run setcap-netadm(pid=16984): Terminated: ok {rc=0} 18:28:08.515024 run srsepc(pid=16985): Launched 18:28:08.637361 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:28:09.759289 run rm-remote-dir(pid=16986): Launched 18:28:09.939127 run srsepc(pid=16985): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16985)] 18:28:10.075778 run srsepc(pid=16985): stdout: | (launched: 2022-12-13_18:28:08.454235) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:28:10.211443 run srsepc(pid=16985): stderr: | (launched: 2022-12-13_18:28:08.503199) | Connection to 10.42.42.116 closed. 18:28:10.347011 run srsepc(pid=16985): stdout: | (launched: 2022-12-13_18:28:08.454235) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:28:10.476630 run srsepc(pid=16985): stderr: | (launched: 2022-12-13_18:28:08.503199) | Connection to 10.42.42.116 closed. 18:28:10.630506 run rm-remote-dir(pid=16986): Terminating (SIGINT) 18:28:10.810257 run rm-remote-dir(pid=16986): Terminated: ok {rc=0} 18:28:10.940377 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=16985): Process ended prematurely: srsepc(pid=16985) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16985)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 18:28:10.950246 tst rrc_idle_mo_ping.py:16: Test FAILED (18.4 sec) 18:28:11.027921 run scp-back-log(pid=16987): Launched 18:28:12.105510 run scp-back-log(pid=16987): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16987)] 18:28:12.166656 run scp-back-log(pid=16987): stdout: | (launched: 2022-12-13_18:28:10.996737) 18:28:12.228915 run scp-back-log(pid=16987): stderr: | (launched: 2022-12-13_18:28:11.016511) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:28:12.299186 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16987): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16987)]') ---------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 18:28:12.345103 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:28:12.361884 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:28:12.384233 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:28:12.439036 tst rrc_idle_mt_ping.py: using MSISDN 8279 18:28:12.562132 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8279', subscriber_id=0} 18:28:12.677792 run srsepc_10.42.42.118: Starting srsepc 18:28:13.352922 run rm-remote-dir(pid=16989): Launched 18:28:14.543435 run rm-remote-dir(pid=16989): Terminated: ok {rc=0} 18:28:14.883413 run mk-remote-dir(pid=16990): Launched 18:28:16.064862 run mk-remote-dir(pid=16990): Terminated: ok {rc=0} 18:28:16.367397 run scp-inst-to-remote(pid=16991): Launched 18:28:18.598212 run scp-inst-to-remote(pid=16991): Terminated: ok {rc=0} 18:28:18.935078 run rm-remote-dir(pid=16993): Launched 18:28:20.116635 run rm-remote-dir(pid=16993): Terminated: ok {rc=0} 18:28:20.454786 run mk-remote-dir(pid=16994): Launched 18:28:21.639391 run mk-remote-dir(pid=16994): Terminated: ok {rc=0} 18:28:21.932257 run scp-cfg-to-remote(pid=16995): Launched 18:28:23.115050 run scp-cfg-to-remote(pid=16995): Terminated: ok {rc=0} 18:28:23.405269 run scp-db-to-remote(pid=16997): Launched 18:28:24.588505 run scp-db-to-remote(pid=16997): Terminated: ok {rc=0} 18:28:24.722198 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:28:25.037721 run patchelf(pid=16999): Launched 18:28:26.219958 run patchelf(pid=16999): Terminated: ok {rc=0} 18:28:26.354586 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:28:26.670347 run setcap-netadm(pid=17000): Launched 18:28:27.851374 run setcap-netadm(pid=17000): Terminated: ok {rc=0} 18:28:28.182335 run srsepc(pid=17001): Launched 18:28:28.300509 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:28:29.432418 run rm-remote-dir(pid=17002): Launched 18:28:29.614713 run srsepc(pid=17001): ERR: Terminated: ERROR {rc=127} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=17001)] 18:28:29.753324 run srsepc(pid=17001): stdout: | (launched: 2022-12-13_18:28:28.124522) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:28:29.891431 run srsepc(pid=17001): stderr: | (launched: 2022-12-13_18:28:28.170910) | Connection to 10.42.42.116 closed. 18:28:30.028408 run srsepc(pid=17001): stdout: | (launched: 2022-12-13_18:28:28.124522) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:28:30.163727 run srsepc(pid=17001): stderr: | (launched: 2022-12-13_18:28:28.170910) | Connection to 10.42.42.116 closed. 18:28:30.319353 run rm-remote-dir(pid=17002): Terminating (SIGINT) 18:28:30.501149 run rm-remote-dir(pid=17002): Terminated: ok {rc=0} 18:28:30.632618 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=17001): Process ended prematurely: srsepc(pid=17001) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=17001)] [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 18:28:30.642602 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 18:28:30.721081 run scp-back-log(pid=17003): Launched 18:28:31.800886 run scp-back-log(pid=17003): ERR: Terminated: ERROR {rc=1} [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=17003)] 18:28:31.886074 run scp-back-log(pid=17003): stdout: | (launched: 2022-12-13_18:28:30.689432) 18:28:31.976191 run scp-back-log(pid=17003): stderr: | (launched: 2022-12-13_18:28:30.709475) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:28:32.073357 tst srsepc_10.42.42.118: Error('scp-back-log(pid=17003): launch_sync(): local process exited with status 1 [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=17003)]') --------------------------------------------------------------------- trial-2392 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 18:28:32.217709 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:32.224141 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 18:28:32.271664 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 18:28:32.300484 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 18:28:32.354053 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 18:28:32.396280 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 18:28:32.422698 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 18:28:32.976407 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 18:28:32.983220 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:32.995163 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:28:33.036042 tst handover.py: using LAC 35436 18:28:33.158497 tst handover.py: using RAC 246 18:28:33.278984 tst handover.py: using CellId 35436 18:28:33.399128 tst handover.py: using BVCI 35437 18:28:33.511786 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:28:33.545304 tst handover.py: using LAC 35437 18:28:33.669309 tst handover.py: using RAC 247 18:28:33.799238 tst handover.py: using CellId 35437 18:28:33.928728 tst handover.py: using BVCI 35438 18:28:34.049859 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:34.061375 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:34.072501 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:34.083740 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:34.095309 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:28:34.106735 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:28:34.226313 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:28:34.348779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:34.858695 run create_hlr_db(pid=17008): Launched 18:28:36.051574 run create_hlr_db(pid=17008): Terminated: ok {rc=0} 18:28:36.399247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17010): Launched 18:28:36.729803 run osmo-hlr_10.42.42.2(pid=17011): Launched 18:28:36.858629 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:37.397356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17013): Launched 18:28:37.705508 run osmo-stp_10.42.42.5(pid=17014): Launched 18:28:37.825017 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:38.383526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17016): Launched 18:28:38.690886 run osmo-msc_10.42.42.6(pid=17017): Launched 18:28:38.865980 run osmo-stp_10.42.42.5(pid=17014): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17014)] 18:28:38.995940 run osmo-stp_10.42.42.5(pid=17014): stdout: | (launched: 2022-12-13_18:28:37.648214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:39.125380 run osmo-stp_10.42.42.5(pid=17014): stderr: | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182837819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:39.252544 run osmo-stp_10.42.42.5(pid=17014): stdout: | (launched: 2022-12-13_18:28:37.648214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:39.374429 run osmo-stp_10.42.42.5(pid=17014): stderr: | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182837818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182837819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182837819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:39.519906 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17014): Process ended prematurely: osmo-stp_10.42.42.5(pid=17014) [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17014)] [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 18:28:39.528257 tst handover.py:18: Test FAILED (6.5 sec) 18:28:39.554666 run osmo-hlr_10.42.42.2(pid=17011): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17011)] 18:28:39.603483 run osmo-hlr_10.42.42.2(pid=17011): stdout: | (launched: 2022-12-13_18:28:36.669986) 18:28:39.653498 run osmo-hlr_10.42.42.2(pid=17011): stderr: | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182836864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182836877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182836885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182836885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182836885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:39.723237 run osmo-msc_10.42.42.6(pid=17017): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17017)] 18:28:39.771469 run osmo-msc_10.42.42.6(pid=17017): stdout: | (launched: 2022-12-13_18:28:38.634115) 18:28:39.821201 run osmo-msc_10.42.42.6(pid=17017): stderr: | [0;m[38;5;43m20221213182838904 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182838904 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b745a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182838904 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182838904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182838904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182838904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182838906 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182838907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182838907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182838907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:39.871816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17010): Terminating (SIGTERM) 18:28:39.912002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17013): Terminating (SIGTERM) 18:28:39.952163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17016): Terminating (SIGTERM) 18:28:39.992528 --- ParallelTerminationStrategy: PID 17010 died... 18:28:40.011950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17010): Terminated: ok {rc=0} 18:28:40.056472 --- ParallelTerminationStrategy: PID 17013 died... 18:28:40.075342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17013): Terminated: ok {rc=0} 18:28:40.119651 --- ParallelTerminationStrategy: PID 17016 died... 18:28:40.138411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17016): Terminated: ok {rc=0} 18:28:40.225165 bus /sierra_3: Setting Powered False 18:28:41.328488 bus /sierra_3: Setting Powered False 18:28:42.448343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 18:28:43.697251 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:43.702886 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 18:28:43.745203 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 18:28:43.772857 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 18:28:43.825415 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 18:28:43.866772 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 18:28:43.894939 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 18:28:44.445629 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 18:28:44.450983 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:44.462051 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:28:44.498765 tst handover.py: using LAC 35438 18:28:44.622170 tst handover.py: using RAC 248 18:28:44.746015 tst handover.py: using CellId 35438 18:28:44.867296 tst handover.py: using BVCI 35439 18:28:44.981128 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:28:45.015346 tst handover.py: using LAC 35439 18:28:45.137041 tst handover.py: using RAC 249 18:28:45.259375 tst handover.py: using CellId 35439 18:28:45.382108 tst handover.py: using BVCI 35440 18:28:45.503303 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:45.514883 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:45.526307 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:45.537623 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:45.549470 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:28:45.561400 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:28:45.682890 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:28:45.805343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:46.313183 run create_hlr_db(pid=17024): Launched 18:28:46.481945 bus /sierra_2: Setting Powered False 18:28:47.544858 run create_hlr_db(pid=17024): Terminated: ok {rc=0} 18:28:47.968404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17026): Launched 18:28:48.299219 run osmo-hlr_10.42.42.2(pid=17027): Launched 18:28:48.427537 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:48.967168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17029): Launched 18:28:49.297603 run osmo-stp_10.42.42.5(pid=17030): Launched 18:28:49.424640 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:49.995434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17032): Launched 18:28:50.327380 run osmo-msc_10.42.42.6(pid=17033): Launched 18:28:50.513957 run osmo-stp_10.42.42.5(pid=17030): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17030)] 18:28:50.655362 run osmo-stp_10.42.42.5(pid=17030): stdout: | (launched: 2022-12-13_18:28:49.237114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:50.796782 run osmo-stp_10.42.42.5(pid=17030): stderr: | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182849426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:50.935510 run osmo-stp_10.42.42.5(pid=17030): stdout: | (launched: 2022-12-13_18:28:49.237114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:51.068597 run osmo-stp_10.42.42.5(pid=17030): stderr: | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182849425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182849426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182849426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:51.227696 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17030): Process ended prematurely: osmo-stp_10.42.42.5(pid=17030) [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17030)] [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 18:28:51.236740 tst handover.py:18: Test FAILED (6.8 sec) 18:28:51.264629 run osmo-hlr_10.42.42.2(pid=17027): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17027)] 18:28:51.316452 run osmo-hlr_10.42.42.2(pid=17027): stdout: | (launched: 2022-12-13_18:28:48.239289) 18:28:51.369871 run osmo-hlr_10.42.42.2(pid=17027): stderr: | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182848433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182848446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182848454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182848454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182848454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:51.443888 run osmo-msc_10.42.42.6(pid=17033): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17033)] 18:28:51.494717 run osmo-msc_10.42.42.6(pid=17033): stdout: | (launched: 2022-12-13_18:28:50.266319) 18:28:51.547892 run osmo-msc_10.42.42.6(pid=17033): stderr: | [0;m[38;5;43m20221213182850586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182850586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58991a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182850586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182850586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182850586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182850586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182850588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182850588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182850588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182850589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:51.601333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17026): Terminating (SIGTERM) 18:28:51.643754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17029): Terminating (SIGTERM) 18:28:51.686602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17032): Terminating (SIGTERM) 18:28:51.729603 --- ParallelTerminationStrategy: PID 17026 died... 18:28:51.750256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17026): Terminated: ok {rc=0} 18:28:51.797723 --- ParallelTerminationStrategy: PID 17029 died... 18:28:51.817733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17029): Terminated: ok {rc=0} 18:28:51.864938 --- ParallelTerminationStrategy: PID 17032 died... 18:28:51.885584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17032): Terminated: ok {rc=0} 18:28:51.977189 bus /sierra_3: Setting Powered False 18:28:53.078502 bus /sierra_3: Setting Powered False 18:28:54.198511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 18:28:55.448312 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:55.453996 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:28:55.509586 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:28:55.537071 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:28:55.590781 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:28:55.644201 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:28:55.670721 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:28:56.224768 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 18:28:56.230647 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:56.242059 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:28:56.281767 tst handover.py: using LAC 35440 18:28:56.414586 tst handover.py: using RAC 250 18:28:56.546434 tst handover.py: using CellId 35440 18:28:56.677168 tst handover.py: using BVCI 35441 18:28:56.798270 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:28:56.851250 tst handover.py: using LAC 35441 18:28:56.974280 tst handover.py: using RAC 251 18:28:57.096917 tst handover.py: using CellId 35441 18:28:57.218910 tst handover.py: using BVCI 35442 18:28:57.333402 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:57.344380 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:57.355253 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:57.366058 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:57.377330 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:57.388475 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:28:57.513763 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:28:57.637224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:58.125435 run create_hlr_db(pid=17039): Launched 18:28:58.255945 bus /sierra_2: Setting Powered False 18:28:59.322228 run create_hlr_db(pid=17039): Terminated: ok {rc=0} 18:28:59.757295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17041): Launched 18:29:00.093782 run osmo-hlr_10.42.42.2(pid=17042): Launched 18:29:00.221976 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:00.768080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17044): Launched 18:29:01.149401 run osmo-stp_10.42.42.5(pid=17045): Launched 18:29:01.329977 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:01.980346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17047): Launched 18:29:02.317927 run osmo-msc_10.42.42.6(pid=17048): Launched 18:29:02.507494 run osmo-stp_10.42.42.5(pid=17045): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17045)] 18:29:02.649237 run osmo-stp_10.42.42.5(pid=17045): stdout: | (launched: 2022-12-13_18:29:01.087909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:02.792097 run osmo-stp_10.42.42.5(pid=17045): stderr: | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182901465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182901465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182901466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182901466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:02.931241 run osmo-stp_10.42.42.5(pid=17045): stdout: | (launched: 2022-12-13_18:29:01.087909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:03.064619 run osmo-stp_10.42.42.5(pid=17045): stderr: | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182901464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182901465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182901465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182901466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182901466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:03.223869 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17045): Process ended prematurely: osmo-stp_10.42.42.5(pid=17045) [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17045)] [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 18:29:03.232905 tst handover.py:18: Test FAILED (7.0 sec) 18:29:03.261337 run osmo-hlr_10.42.42.2(pid=17042): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17042)] 18:29:03.313665 run osmo-hlr_10.42.42.2(pid=17042): stdout: | (launched: 2022-12-13_18:29:00.032501) 18:29:03.367102 run osmo-hlr_10.42.42.2(pid=17042): stderr: | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182900243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182900253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182900253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182900253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:03.442099 run osmo-msc_10.42.42.6(pid=17048): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17048)] 18:29:03.493310 run osmo-msc_10.42.42.6(pid=17048): stdout: | (launched: 2022-12-13_18:29:02.259786) 18:29:03.546630 run osmo-msc_10.42.42.6(pid=17048): stderr: | [0;m[38;5;43m20221213182902581 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182902581 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd4de486c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182902582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182902582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182902582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182902582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182902584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:03.599931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17041): Terminating (SIGTERM) 18:29:03.642849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17044): Terminating (SIGTERM) 18:29:03.685769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17047): Terminating (SIGTERM) 18:29:03.729174 --- ParallelTerminationStrategy: PID 17041 died... 18:29:03.750136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17041): Terminated: ok {rc=0} 18:29:03.798526 --- ParallelTerminationStrategy: PID 17044 died... 18:29:03.818891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17044): Terminated: ok {rc=0} 18:29:03.866700 --- ParallelTerminationStrategy: PID 17047 died... 18:29:03.887193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17047): Terminated: ok {rc=0} 18:29:03.978907 bus /sierra_3: Setting Powered False 18:29:05.079542 bus /sierra_3: Setting Powered False 18:29:06.198159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:29:07.460845 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:07.466625 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:29:07.516317 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:29:07.542884 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:29:07.595629 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:29:07.648100 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:29:07.675546 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:29:08.226891 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:29:08.232733 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:08.244478 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:29:08.285251 tst handover.py: using LAC 35442 18:29:08.415077 tst handover.py: using RAC 252 18:29:08.545928 tst handover.py: using CellId 35442 18:29:08.676855 tst handover.py: using BVCI 35443 18:29:08.799713 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:29:08.845753 tst handover.py: using LAC 35443 18:29:08.980008 tst handover.py: using RAC 253 18:29:09.109801 tst handover.py: using CellId 35443 18:29:09.237429 tst handover.py: using BVCI 35444 18:29:09.349927 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:09.361254 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:09.372322 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:09.383432 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:09.394490 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:09.405380 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:29:09.529722 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:29:09.649333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:10.104197 run create_hlr_db(pid=17053): Launched 18:29:10.232142 bus /sierra_2: Setting Powered False 18:29:11.294150 run create_hlr_db(pid=17053): Terminated: ok {rc=0} 18:29:11.720700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17056): Launched 18:29:12.074723 run osmo-hlr_10.42.42.2(pid=17057): Launched 18:29:12.205306 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:12.751872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17059): Launched 18:29:13.085688 run osmo-stp_10.42.42.5(pid=17060): Launched 18:29:13.213707 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:13.791949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17062): Launched 18:29:14.127739 run osmo-msc_10.42.42.6(pid=17063): Launched 18:29:14.315522 run osmo-stp_10.42.42.5(pid=17060): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17060)] 18:29:14.455902 run osmo-stp_10.42.42.5(pid=17060): stdout: | (launched: 2022-12-13_18:29:13.024561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:14.596459 run osmo-stp_10.42.42.5(pid=17060): stderr: | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182913216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:14.735570 run osmo-stp_10.42.42.5(pid=17060): stdout: | (launched: 2022-12-13_18:29:13.024561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:14.868913 run osmo-stp_10.42.42.5(pid=17060): stderr: | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182913215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182913216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182913216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:15.027827 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17060): Process ended prematurely: osmo-stp_10.42.42.5(pid=17060) [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17060)] [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 18:29:15.037391 tst handover.py:18: Test FAILED (6.8 sec) 18:29:15.065432 run osmo-hlr_10.42.42.2(pid=17057): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17057)] 18:29:15.117119 run osmo-hlr_10.42.42.2(pid=17057): stdout: | (launched: 2022-12-13_18:29:12.014088) 18:29:15.170704 run osmo-hlr_10.42.42.2(pid=17057): stderr: | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182912210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182912223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182912233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182912234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182912234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:15.244414 run osmo-msc_10.42.42.6(pid=17063): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17063)] 18:29:15.294864 run osmo-msc_10.42.42.6(pid=17063): stdout: | (launched: 2022-12-13_18:29:14.066379) 18:29:15.347984 run osmo-msc_10.42.42.6(pid=17063): stderr: | [0;m[38;5;43m20221213182914389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182914389 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb26eacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182914389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182914389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182914389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182914390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182914391 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182914392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182914392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182914392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:15.401557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17056): Terminating (SIGTERM) 18:29:15.444156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17059): Terminating (SIGTERM) 18:29:15.487476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17062): Terminating (SIGTERM) 18:29:15.530960 --- ParallelTerminationStrategy: PID 17056 died... 18:29:15.551955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17056): Terminated: ok {rc=0} 18:29:15.599397 --- ParallelTerminationStrategy: PID 17059 died... 18:29:15.619953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17059): Terminated: ok {rc=0} 18:29:15.667595 --- ParallelTerminationStrategy: PID 17062 died... 18:29:15.687856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17062): Terminated: ok {rc=0} 18:29:15.778469 bus /sierra_3: Setting Powered False 18:29:16.899870 bus /sierra_3: Setting Powered False 18:29:18.020056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:29:19.279594 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:19.284686 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:29:19.338492 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:29:19.364915 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:29:19.416182 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:29:19.470209 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:29:19.496463 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:29:20.049416 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:29:20.054849 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:20.066030 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:29:20.103653 tst handover.py: using LAC 35444 18:29:20.227873 tst handover.py: using RAC 254 18:29:20.351681 tst handover.py: using CellId 35444 18:29:20.474812 tst handover.py: using BVCI 35445 18:29:20.588853 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:29:20.637680 tst handover.py: using LAC 35445 18:29:20.758580 tst handover.py: using RAC 255 18:29:20.881800 tst handover.py: using CellId 35445 18:29:21.017455 tst handover.py: using BVCI 35446 18:29:21.139887 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:21.151521 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:21.163004 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:21.174950 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:21.187298 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:21.199557 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:29:21.325875 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:29:21.445238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:21.898801 run create_hlr_db(pid=17068): Launched 18:29:22.028776 bus /sierra_2: Setting Powered False 18:29:23.090881 run create_hlr_db(pid=17068): Terminated: ok {rc=0} 18:29:23.497716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Launched 18:29:23.807755 run osmo-hlr_10.42.42.2(pid=17071): Launched 18:29:23.926060 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:24.431788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Launched 18:29:24.743178 run osmo-stp_10.42.42.5(pid=17074): Launched 18:29:24.861924 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:25.395268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17076): Launched 18:29:25.705733 run osmo-msc_10.42.42.6(pid=17077): Launched 18:29:25.879929 run osmo-stp_10.42.42.5(pid=17074): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] 18:29:26.011041 run osmo-stp_10.42.42.5(pid=17074): stdout: | (launched: 2022-12-13_18:29:24.686002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:26.142466 run osmo-stp_10.42.42.5(pid=17074): stderr: | [0;m[38;5;43m20221213182924853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182924854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182924854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182924854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:26.272287 run osmo-stp_10.42.42.5(pid=17074): stdout: | (launched: 2022-12-13_18:29:24.686002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:26.396110 run osmo-stp_10.42.42.5(pid=17074): stderr: | [0;m[38;5;43m20221213182924853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182924854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182924854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182924854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182924855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:26.543826 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17074): Process ended prematurely: osmo-stp_10.42.42.5(pid=17074) [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 18:29:26.552477 tst handover.py:18: Test FAILED (6.5 sec) 18:29:26.579146 run osmo-hlr_10.42.42.2(pid=17071): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17071)] 18:29:26.627754 run osmo-hlr_10.42.42.2(pid=17071): stdout: | (launched: 2022-12-13_18:29:23.750711) 18:29:26.678006 run osmo-hlr_10.42.42.2(pid=17071): stderr: | [0;m[1;31m20221213182923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182923937 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:26.748279 run osmo-msc_10.42.42.6(pid=17077): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17077)] 18:29:26.796589 run osmo-msc_10.42.42.6(pid=17077): stdout: | (launched: 2022-12-13_18:29:25.648630) 18:29:26.846550 run osmo-msc_10.42.42.6(pid=17077): stderr: | [0;m[38;5;43m20221213182925920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182925920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f063b226c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182925920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182925920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182925921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182925921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182925923 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182925923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182925923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182925923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:26.897025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Terminating (SIGTERM) 18:29:26.937193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Terminating (SIGTERM) 18:29:26.977664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17076): Terminating (SIGTERM) 18:29:27.018141 --- ParallelTerminationStrategy: PID 17070 died... 18:29:27.037569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Terminated: ok {rc=0} 18:29:27.082030 --- ParallelTerminationStrategy: PID 17073 died... 18:29:27.100998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Terminated: ok {rc=0} 18:29:27.145489 --- ParallelTerminationStrategy: PID 17076 died... 18:29:27.164324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17076): Terminated: ok {rc=0} 18:29:27.249376 bus /sierra_3: Setting Powered False 18:29:28.348898 bus /sierra_3: Setting Powered False 18:29:29.468576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 18:29:30.729763 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:30.734933 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:29:30.776345 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:29:30.803463 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:29:30.881340 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:29:30.924485 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:29:30.952317 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:29:31.489165 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 18:29:31.495600 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:31.507530 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 18:29:31.550808 tst handover.py: using LAC 35446 18:29:31.722110 tst handover.py: using RAC 1 18:29:31.846137 tst handover.py: using CellId 35446 18:29:32.021682 tst handover.py: using BVCI 35447 18:29:32.144766 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 18:29:32.181683 tst handover.py: using LAC 35447 18:29:32.312561 tst handover.py: using RAC 2 18:29:32.442514 tst handover.py: using CellId 35447 18:29:32.570652 tst handover.py: using BVCI 35448 18:29:32.691552 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:32.702934 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:32.714113 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:32.725305 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:32.736894 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:32.748482 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 18:29:32.872724 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 18:29:32.993442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:33.479403 run create_hlr_db(pid=17082): Launched 18:29:33.606039 bus /sierra_2: Setting Powered False 18:29:34.673614 run create_hlr_db(pid=17082): Terminated: ok {rc=0} 18:29:35.091151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17084): Launched 18:29:35.402926 run osmo-hlr_10.42.42.2(pid=17085): Launched 18:29:35.520729 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:36.041532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17087): Launched 18:29:36.353079 run osmo-stp_10.42.42.5(pid=17088): Launched 18:29:36.471819 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:37.007156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17090): Launched 18:29:37.321166 run osmo-msc_10.42.42.6(pid=17091): Launched 18:29:37.495582 run osmo-stp_10.42.42.5(pid=17088): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17088)] 18:29:37.626949 run osmo-stp_10.42.42.5(pid=17088): stdout: | (launched: 2022-12-13_18:29:36.295223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:37.758844 run osmo-stp_10.42.42.5(pid=17088): stderr: | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182936464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:37.888577 run osmo-stp_10.42.42.5(pid=17088): stdout: | (launched: 2022-12-13_18:29:36.295223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:38.012665 run osmo-stp_10.42.42.5(pid=17088): stderr: | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182936464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182936464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182936465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:38.160687 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17088): Process ended prematurely: osmo-stp_10.42.42.5(pid=17088) [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17088)] [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 18:29:38.169384 tst handover.py:18: Test FAILED (6.7 sec) 18:29:38.196152 run osmo-hlr_10.42.42.2(pid=17085): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17085)] 18:29:38.245010 run osmo-hlr_10.42.42.2(pid=17085): stdout: | (launched: 2022-12-13_18:29:35.345265) 18:29:38.295283 run osmo-hlr_10.42.42.2(pid=17085): stderr: | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182935518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182935530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182935538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182935539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182935539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:38.366126 run osmo-msc_10.42.42.6(pid=17091): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17091)] 18:29:38.414413 run osmo-msc_10.42.42.6(pid=17091): stdout: | (launched: 2022-12-13_18:29:37.263723) 18:29:38.464422 run osmo-msc_10.42.42.6(pid=17091): stderr: | [0;m[38;5;43m20221213182937535 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182937536 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f85185a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182937536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182937536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182937536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182937536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182937538 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182937538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182937539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182937539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:38.514570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17084): Terminating (SIGTERM) 18:29:38.555079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17087): Terminating (SIGTERM) 18:29:38.595719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17090): Terminating (SIGTERM) 18:29:38.636609 --- ParallelTerminationStrategy: PID 17084 died... 18:29:38.656328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17084): Terminated: ok {rc=0} 18:29:38.701667 --- ParallelTerminationStrategy: PID 17087 died... 18:29:38.720920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17087): Terminated: ok {rc=0} 18:29:38.765956 --- ParallelTerminationStrategy: PID 17090 died... 18:29:38.785243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17090): Terminated: ok {rc=0} 18:29:38.874697 bus /sierra_3: Setting Powered False 18:29:39.979243 bus /sierra_3: Setting Powered False 18:29:41.101089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 18:29:42.359906 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:42.366104 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:29:42.419450 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:29:42.445847 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:29:42.496453 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:29:42.552015 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:29:42.579591 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:29:43.128613 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 18:29:43.134140 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:43.145097 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:29:43.182163 tst handover.py: using LAC 35448 18:29:43.301583 tst handover.py: using RAC 3 18:29:43.433740 tst handover.py: using CellId 35448 18:29:43.562609 tst handover.py: using BVCI 35449 18:29:43.683730 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:29:43.735523 tst handover.py: using LAC 35449 18:29:43.858201 tst handover.py: using RAC 4 18:29:43.977465 tst handover.py: using CellId 35449 18:29:44.099567 tst handover.py: using BVCI 35450 18:29:44.213367 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:44.224232 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:44.234998 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:44.245912 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:44.256685 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:29:44.267378 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:29:44.389389 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:29:44.508688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:44.962440 run create_hlr_db(pid=17096): Launched 18:29:45.090071 bus /sierra_2: Setting Powered False 18:29:46.160388 run create_hlr_db(pid=17096): Terminated: ok {rc=0} 18:29:46.686794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17098): Launched 18:29:47.021764 run osmo-hlr_10.42.42.2(pid=17099): Launched 18:29:47.261956 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:47.830563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17101): Launched 18:29:48.163474 run osmo-stp_10.42.42.5(pid=17102): Launched 18:29:48.292225 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:48.864198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17104): Launched 18:29:49.196278 run osmo-msc_10.42.42.6(pid=17105): Launched 18:29:49.379984 run osmo-stp_10.42.42.5(pid=17102): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17102)] 18:29:49.519244 run osmo-stp_10.42.42.5(pid=17102): stdout: | (launched: 2022-12-13_18:29:48.102718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:49.658953 run osmo-stp_10.42.42.5(pid=17102): stderr: | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182948292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:49.796777 run osmo-stp_10.42.42.5(pid=17102): stdout: | (launched: 2022-12-13_18:29:48.102718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:49.929367 run osmo-stp_10.42.42.5(pid=17102): stderr: | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213182948291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213182948292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213182948292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:50.087475 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17102): Process ended prematurely: osmo-stp_10.42.42.5(pid=17102) [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17102)] [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 18:29:50.096432 tst handover.py:18: Test FAILED (7.0 sec) 18:29:50.124287 run osmo-hlr_10.42.42.2(pid=17099): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17099)] 18:29:50.175838 run osmo-hlr_10.42.42.2(pid=17099): stdout: | (launched: 2022-12-13_18:29:46.958946) 18:29:50.228434 run osmo-hlr_10.42.42.2(pid=17099): stderr: | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182947253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182947280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182947288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182947293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182947293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:50.302199 run osmo-msc_10.42.42.6(pid=17105): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17105)] 18:29:50.352846 run osmo-msc_10.42.42.6(pid=17105): stdout: | (launched: 2022-12-13_18:29:49.135562) 18:29:50.405533 run osmo-msc_10.42.42.6(pid=17105): stderr: | [0;m[38;5;43m20221213182949454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213182949455 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10f8267c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213182949455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213182949455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213182949455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213182949455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213182949457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213182949457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213182949457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213182949458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:50.458721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17098): Terminating (SIGTERM) 18:29:50.500880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17101): Terminating (SIGTERM) 18:29:50.543984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17104): Terminating (SIGTERM) 18:29:50.587009 --- ParallelTerminationStrategy: PID 17098 died... 18:29:50.607721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17098): Terminated: ok {rc=0} 18:29:50.655544 --- ParallelTerminationStrategy: PID 17101 died... 18:29:50.675801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17101): Terminated: ok {rc=0} 18:29:50.723121 --- ParallelTerminationStrategy: PID 17104 died... 18:29:50.743349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17104): Terminated: ok {rc=0} 18:29:50.833798 bus /sierra_3: Setting Powered False 18:29:51.935053 bus /sierra_3: Setting Powered False 18:29:53.056421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 18:29:54.319545 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:54.324788 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:29:54.378463 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:29:54.405056 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:29:54.456813 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:29:54.512143 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:29:54.539478 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:29:55.086454 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 18:29:55.092626 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:55.103938 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:29:55.142216 tst handover.py: using LAC 35450 18:29:55.263260 tst handover.py: using RAC 5 18:29:55.385575 tst handover.py: using CellId 35450 18:29:55.510768 tst handover.py: using BVCI 35451 18:29:55.624400 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:29:55.670608 tst handover.py: using LAC 35451 18:29:55.790810 tst handover.py: using RAC 6 18:29:55.911370 tst handover.py: using CellId 35451 18:29:56.037362 tst handover.py: using BVCI 35452 18:29:56.151648 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:56.162676 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:56.173578 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:56.184271 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:56.196165 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:56.207778 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:29:56.330385 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:29:56.453079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:56.940507 run create_hlr_db(pid=17111): Launched 18:29:57.069472 bus /sierra_2: Setting Powered False 18:29:58.134991 run create_hlr_db(pid=17111): Terminated: ok {rc=0} 18:29:58.555237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17113): Launched 18:29:58.890380 run osmo-hlr_10.42.42.2(pid=17114): Launched 18:29:59.019000 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:59.567059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17116): Launched 18:29:59.899618 run osmo-stp_10.42.42.5(pid=17117): Launched 18:30:00.027836 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:00.600126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17119): Launched 18:30:00.954353 run osmo-msc_10.42.42.6(pid=17120): Launched 18:30:01.198777 run osmo-stp_10.42.42.5(pid=17117): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17117)] 18:30:01.500061 run osmo-stp_10.42.42.5(pid=17117): stdout: | (launched: 2022-12-13_18:29:59.839266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:01.766708 run osmo-stp_10.42.42.5(pid=17117): stderr: | [0;m[38;5;43m20221213183000027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183000028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183000028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183000028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:01.939152 run osmo-stp_10.42.42.5(pid=17117): stdout: | (launched: 2022-12-13_18:29:59.839266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:02.099481 run osmo-stp_10.42.42.5(pid=17117): stderr: | [0;m[38;5;43m20221213183000027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183000028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183000028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183000028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183000029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:02.264453 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17117): Process ended prematurely: osmo-stp_10.42.42.5(pid=17117) [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17117)] [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 18:30:02.274688 tst handover.py:18: Test FAILED (7.2 sec) 18:30:02.303997 run osmo-hlr_10.42.42.2(pid=17114): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17114)] 18:30:02.360492 run osmo-hlr_10.42.42.2(pid=17114): stdout: | (launched: 2022-12-13_18:29:58.829608) 18:30:02.417501 run osmo-hlr_10.42.42.2(pid=17114): stderr: | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213182959025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213182959038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213182959046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213182959046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213182959047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:02.495109 run osmo-msc_10.42.42.6(pid=17120): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17120)] 18:30:02.547720 run osmo-msc_10.42.42.6(pid=17120): stdout: | (launched: 2022-12-13_18:30:00.893143) 18:30:02.602200 run osmo-msc_10.42.42.6(pid=17120): stderr: | [0;m[38;5;43m20221213183001514 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183001514 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c150a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183001514 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183001514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183001514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183001515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183001516 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183001517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183001517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183001517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:02.656410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17113): Terminating (SIGTERM) 18:30:02.699435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17116): Terminating (SIGTERM) 18:30:02.743627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17119): Terminating (SIGTERM) 18:30:02.788220 --- ParallelTerminationStrategy: PID 17113 died... 18:30:02.809889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17113): Terminated: ok {rc=0} 18:30:02.859248 --- ParallelTerminationStrategy: PID 17116 died... 18:30:02.880556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17116): Terminated: ok {rc=0} 18:30:02.929058 --- ParallelTerminationStrategy: PID 17119 died... 18:30:02.950152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17119): Terminated: ok {rc=0} 18:30:03.044759 bus /sierra_3: Setting Powered False 18:30:04.145600 bus /sierra_3: Setting Powered False 18:30:05.267146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 18:30:06.528310 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:06.533348 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 18:30:06.570506 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 18:30:06.597179 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 18:30:06.647972 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 18:30:06.684462 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 18:30:06.710860 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 18:30:07.261625 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 18:30:07.266863 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:07.277839 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 18:30:07.311404 tst handover.py: using LAC 35452 18:30:07.433591 tst handover.py: using RAC 7 18:30:07.557544 tst handover.py: using CellId 35452 18:30:07.690849 tst handover.py: using BVCI 35453 18:30:07.811841 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 18:30:07.847260 tst handover.py: using LAC 35453 18:30:07.979050 tst handover.py: using RAC 8 18:30:08.110855 tst handover.py: using CellId 35453 18:30:08.242071 tst handover.py: using BVCI 35454 18:30:08.363142 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:08.374567 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:08.385740 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:08.396719 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:08.408075 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:30:08.419473 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 18:30:08.538400 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 18:30:08.663763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:09.150992 run create_hlr_db(pid=17128): Launched 18:30:09.282316 bus /sierra_2: Setting Powered False 18:30:10.348097 run create_hlr_db(pid=17128): Terminated: ok {rc=0} 18:30:10.769269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17130): Launched 18:30:11.081730 run osmo-hlr_10.42.42.2(pid=17131): Launched 18:30:11.199952 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:11.708767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17133): Launched 18:30:12.019694 run osmo-stp_10.42.42.5(pid=17134): Launched 18:30:12.138116 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:12.675045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17136): Launched 18:30:12.988229 run osmo-msc_10.42.42.6(pid=17137): Launched 18:30:13.161468 run osmo-stp_10.42.42.5(pid=17134): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17134)] 18:30:13.293542 run osmo-stp_10.42.42.5(pid=17134): stdout: | (launched: 2022-12-13_18:30:11.962631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:13.424122 run osmo-stp_10.42.42.5(pid=17134): stderr: | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183012130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:13.553943 run osmo-stp_10.42.42.5(pid=17134): stdout: | (launched: 2022-12-13_18:30:11.962631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:13.677345 run osmo-stp_10.42.42.5(pid=17134): stderr: | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183012129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183012130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183012130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:13.824852 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17134): Process ended prematurely: osmo-stp_10.42.42.5(pid=17134) [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17134)] [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 18:30:13.833699 tst handover.py:18: Test FAILED (6.6 sec) 18:30:13.860246 run osmo-hlr_10.42.42.2(pid=17131): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17131)] 18:30:13.908908 run osmo-hlr_10.42.42.2(pid=17131): stdout: | (launched: 2022-12-13_18:30:11.024672) 18:30:13.959117 run osmo-hlr_10.42.42.2(pid=17131): stderr: | [0;m[1;31m20221213183011198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183011198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183011198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183011199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183011199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183011199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183011211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183011219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183011220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183011220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:14.029255 run osmo-msc_10.42.42.6(pid=17137): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17137)] 18:30:14.077612 run osmo-msc_10.42.42.6(pid=17137): stdout: | (launched: 2022-12-13_18:30:12.930842) 18:30:14.127589 run osmo-msc_10.42.42.6(pid=17137): stderr: | [0;m[38;5;43m20221213183013201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183013202 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2f64bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183013202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183013202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183013202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183013202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183013204 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183013204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183013204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183013204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:14.177993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17130): Terminating (SIGTERM) 18:30:14.218088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17133): Terminating (SIGTERM) 18:30:14.258344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17136): Terminating (SIGTERM) 18:30:14.299111 --- ParallelTerminationStrategy: PID 17130 died... 18:30:14.318899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17130): Terminated: ok {rc=0} 18:30:14.363895 --- ParallelTerminationStrategy: PID 17133 died... 18:30:14.382909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17133): Terminated: ok {rc=0} 18:30:14.427644 --- ParallelTerminationStrategy: PID 17136 died... 18:30:14.446541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17136): Terminated: ok {rc=0} 18:30:14.534742 bus /sierra_3: Setting Powered False 18:30:15.636287 bus /sierra_3: Setting Powered False 18:30:16.758817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 18:30:18.006566 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:18.012378 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:30:18.065043 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:30:18.092611 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:30:18.147523 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:30:18.199973 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:30:18.227309 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:30:18.773378 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 18:30:18.778557 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:18.789456 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:30:18.823619 tst handover.py: using LAC 35454 18:30:18.945986 tst handover.py: using RAC 9 18:30:19.069429 tst handover.py: using CellId 35454 18:30:19.193865 tst handover.py: using BVCI 35455 18:30:19.307424 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:30:19.356028 tst handover.py: using LAC 35455 18:30:19.479014 tst handover.py: using RAC 10 18:30:19.607761 tst handover.py: using CellId 35455 18:30:19.729139 tst handover.py: using BVCI 35456 18:30:19.852062 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:19.863599 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:19.874954 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:19.886227 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:19.897789 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:19.909332 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:30:20.030229 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:30:20.150327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:20.604380 run create_hlr_db(pid=17143): Launched 18:30:20.732386 bus /sierra_2: Setting Powered False 18:30:21.795128 run create_hlr_db(pid=17143): Terminated: ok {rc=0} 18:30:22.221881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17145): Launched 18:30:22.536016 run osmo-hlr_10.42.42.2(pid=17146): Launched 18:30:22.655120 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:23.163207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17148): Launched 18:30:23.473753 run osmo-stp_10.42.42.5(pid=17149): Launched 18:30:23.592062 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:24.129181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17151): Launched 18:30:24.440625 run osmo-msc_10.42.42.6(pid=17152): Launched 18:30:24.614813 run osmo-stp_10.42.42.5(pid=17149): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17149)] 18:30:24.747251 run osmo-stp_10.42.42.5(pid=17149): stdout: | (launched: 2022-12-13_18:30:23.416407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:24.878296 run osmo-stp_10.42.42.5(pid=17149): stderr: | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183023587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:25.007289 run osmo-stp_10.42.42.5(pid=17149): stdout: | (launched: 2022-12-13_18:30:23.416407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:25.130600 run osmo-stp_10.42.42.5(pid=17149): stderr: | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183023586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183023587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183023587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:25.278230 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17149): Process ended prematurely: osmo-stp_10.42.42.5(pid=17149) [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17149)] [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 18:30:25.286898 tst handover.py:18: Test FAILED (6.5 sec) 18:30:25.313586 run osmo-hlr_10.42.42.2(pid=17146): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17146)] 18:30:25.362306 run osmo-hlr_10.42.42.2(pid=17146): stdout: | (launched: 2022-12-13_18:30:22.479059) 18:30:25.412390 run osmo-hlr_10.42.42.2(pid=17146): stderr: | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183022655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183022667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183022675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183022675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183022675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:25.482553 run osmo-msc_10.42.42.6(pid=17152): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17152)] 18:30:25.530864 run osmo-msc_10.42.42.6(pid=17152): stdout: | (launched: 2022-12-13_18:30:24.383114) 18:30:25.581111 run osmo-msc_10.42.42.6(pid=17152): stderr: | [0;m[38;5;43m20221213183024653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183024654 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6bc5816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183024654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183024654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183024654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183024654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183024656 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183024656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183024656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183024656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:25.631504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17145): Terminating (SIGTERM) 18:30:25.671882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17148): Terminating (SIGTERM) 18:30:25.712258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17151): Terminating (SIGTERM) 18:30:25.752922 --- ParallelTerminationStrategy: PID 17145 died... 18:30:25.772359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17145): Terminated: ok {rc=0} 18:30:25.817513 --- ParallelTerminationStrategy: PID 17148 died... 18:30:25.836418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17148): Terminated: ok {rc=0} 18:30:25.881098 --- ParallelTerminationStrategy: PID 17151 died... 18:30:25.899993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17151): Terminated: ok {rc=0} 18:30:25.987835 bus /sierra_3: Setting Powered False 18:30:27.089690 bus /sierra_3: Setting Powered False 18:30:28.207499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:30:29.466367 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:29.471629 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:30:29.518100 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:30:29.544472 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:30:29.595163 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:30:29.641312 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:30:29.667713 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:30:30.221546 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:30:30.228372 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:30.240882 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:30:30.277101 tst handover.py: using LAC 35456 18:30:30.407916 tst handover.py: using RAC 11 18:30:30.540821 tst handover.py: using CellId 35456 18:30:30.671191 tst handover.py: using BVCI 35457 18:30:30.794183 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:30:30.847787 tst handover.py: using LAC 35457 18:30:30.979610 tst handover.py: using RAC 12 18:30:31.111303 tst handover.py: using CellId 35457 18:30:31.244315 tst handover.py: using BVCI 35458 18:30:31.368278 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:31.380466 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:31.392450 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:31.404448 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:31.416893 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:31.429169 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:30:31.581904 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:30:31.702767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:32.228858 run create_hlr_db(pid=17157): Launched 18:30:32.388840 bus /sierra_2: Setting Powered False 18:30:33.454407 run create_hlr_db(pid=17157): Terminated: ok {rc=0} 18:30:33.873181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17159): Launched 18:30:34.186101 run osmo-hlr_10.42.42.2(pid=17160): Launched 18:30:34.307425 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:34.818983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17162): Launched 18:30:35.130715 run osmo-stp_10.42.42.5(pid=17163): Launched 18:30:35.248794 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:35.786082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17165): Launched 18:30:36.100543 run osmo-msc_10.42.42.6(pid=17166): Launched 18:30:36.275819 run osmo-stp_10.42.42.5(pid=17163): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17163)] 18:30:36.406546 run osmo-stp_10.42.42.5(pid=17163): stdout: | (launched: 2022-12-13_18:30:35.073211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:36.536785 run osmo-stp_10.42.42.5(pid=17163): stderr: | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183035244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:36.665816 run osmo-stp_10.42.42.5(pid=17163): stdout: | (launched: 2022-12-13_18:30:35.073211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:36.789649 run osmo-stp_10.42.42.5(pid=17163): stderr: | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183035244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183035244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183035245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:36.938279 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17163): Process ended prematurely: osmo-stp_10.42.42.5(pid=17163) [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17163)] [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 18:30:36.946554 tst handover.py:18: Test FAILED (6.7 sec) 18:30:36.973223 run osmo-hlr_10.42.42.2(pid=17160): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17160)] 18:30:37.022099 run osmo-hlr_10.42.42.2(pid=17160): stdout: | (launched: 2022-12-13_18:30:34.128469) 18:30:37.072225 run osmo-hlr_10.42.42.2(pid=17160): stderr: | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183034301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183034315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183034323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183034324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183034324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:37.141981 run osmo-msc_10.42.42.6(pid=17166): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17166)] 18:30:37.190178 run osmo-msc_10.42.42.6(pid=17166): stdout: | (launched: 2022-12-13_18:30:36.043124) 18:30:37.240036 run osmo-msc_10.42.42.6(pid=17166): stderr: | [0;m[38;5;43m20221213183036313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183036313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b45309c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183036313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183036313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183036314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183036314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183036315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183036316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183036316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183036316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:37.290514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17159): Terminating (SIGTERM) 18:30:37.330553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17162): Terminating (SIGTERM) 18:30:37.370495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17165): Terminating (SIGTERM) 18:30:37.410777 --- ParallelTerminationStrategy: PID 17159 died... 18:30:37.430187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17159): Terminated: ok {rc=0} 18:30:37.474618 --- ParallelTerminationStrategy: PID 17162 died... 18:30:37.493467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17162): Terminated: ok {rc=0} 18:30:37.537917 --- ParallelTerminationStrategy: PID 17165 died... 18:30:37.556789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17165): Terminated: ok {rc=0} 18:30:37.643933 bus /sierra_3: Setting Powered False 18:30:38.744842 bus /sierra_3: Setting Powered False 18:30:39.862134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:30:41.121417 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:41.126594 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:30:41.177255 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:30:41.203691 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:30:41.255886 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:30:41.308788 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:30:41.336702 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:30:41.890571 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:30:41.896353 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:41.907975 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:30:41.943616 tst handover.py: using LAC 35458 18:30:42.076408 tst handover.py: using RAC 13 18:30:42.200798 tst handover.py: using CellId 35458 18:30:42.324289 tst handover.py: using BVCI 35459 18:30:42.439398 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:30:42.489773 tst handover.py: using LAC 35459 18:30:42.612854 tst handover.py: using RAC 14 18:30:42.736450 tst handover.py: using CellId 35459 18:30:42.860099 tst handover.py: using BVCI 35460 18:30:42.973970 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:42.985060 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:42.995782 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:43.006548 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:43.017473 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:43.028225 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:30:43.151668 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:30:43.273803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:43.760705 run create_hlr_db(pid=17171): Launched 18:30:43.888455 bus /sierra_2: Setting Powered False 18:30:44.950240 run create_hlr_db(pid=17171): Terminated: ok {rc=0} 18:30:45.359783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17173): Launched 18:30:45.671954 run osmo-hlr_10.42.42.2(pid=17174): Launched 18:30:45.790997 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:46.474010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17176): Launched 18:30:46.797393 run osmo-stp_10.42.42.5(pid=17177): Launched 18:30:47.036519 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:47.668851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17179): Launched 18:30:47.980228 run osmo-msc_10.42.42.6(pid=17180): Launched 18:30:48.153083 run osmo-stp_10.42.42.5(pid=17177): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17177)] 18:30:48.283514 run osmo-stp_10.42.42.5(pid=17177): stdout: | (launched: 2022-12-13_18:30:46.738277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:48.414977 run osmo-stp_10.42.42.5(pid=17177): stderr: | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183047069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:48.543846 run osmo-stp_10.42.42.5(pid=17177): stdout: | (launched: 2022-12-13_18:30:46.738277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:48.667057 run osmo-stp_10.42.42.5(pid=17177): stderr: | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183047064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183047069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183047070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:48.814934 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17177): Process ended prematurely: osmo-stp_10.42.42.5(pid=17177) [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17177)] [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 18:30:48.823171 tst handover.py:18: Test FAILED (6.9 sec) 18:30:48.849572 run osmo-hlr_10.42.42.2(pid=17174): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17174)] 18:30:48.898370 run osmo-hlr_10.42.42.2(pid=17174): stdout: | (launched: 2022-12-13_18:30:45.614805) 18:30:48.948339 run osmo-hlr_10.42.42.2(pid=17174): stderr: | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183045789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183045801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183045809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183045809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183045810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:49.018272 run osmo-msc_10.42.42.6(pid=17180): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17180)] 18:30:49.066619 run osmo-msc_10.42.42.6(pid=17180): stdout: | (launched: 2022-12-13_18:30:47.923030) 18:30:49.116556 run osmo-msc_10.42.42.6(pid=17180): stderr: | [0;m[38;5;43m20221213183048194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183048194 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cceeeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183048194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183048194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183048195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183048195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183048196 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183048197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183048197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183048197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:49.167061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17173): Terminating (SIGTERM) 18:30:49.207255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17176): Terminating (SIGTERM) 18:30:49.247454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17179): Terminating (SIGTERM) 18:30:49.287898 --- ParallelTerminationStrategy: PID 17173 died... 18:30:49.307346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17173): Terminated: ok {rc=0} 18:30:49.352438 --- ParallelTerminationStrategy: PID 17176 died... 18:30:49.371443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17176): Terminated: ok {rc=0} 18:30:49.416212 --- ParallelTerminationStrategy: PID 17179 died... 18:30:49.435158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17179): Terminated: ok {rc=0} 18:30:49.523158 bus /sierra_3: Setting Powered False 18:30:50.624340 bus /sierra_3: Setting Powered False 18:30:51.743079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 18:30:53.003432 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:53.008870 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:30:53.048848 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:30:53.076647 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:30:53.131029 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:30:53.170896 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:30:53.198669 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:30:53.747985 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 18:30:53.754594 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:53.765827 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 18:30:53.801120 tst handover.py: using LAC 35460 18:30:53.932635 tst handover.py: using RAC 15 18:30:54.061904 tst handover.py: using CellId 35460 18:30:54.198358 tst handover.py: using BVCI 35461 18:30:54.319668 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 18:30:54.354313 tst handover.py: using LAC 35461 18:30:54.483240 tst handover.py: using RAC 16 18:30:54.612488 tst handover.py: using CellId 35461 18:30:54.740736 tst handover.py: using BVCI 35462 18:30:54.862454 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:54.873879 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:54.885282 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:54.896572 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:54.908258 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:30:54.919879 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 18:30:55.039924 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 18:30:55.160743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:55.647712 run create_hlr_db(pid=17185): Launched 18:30:55.776332 bus /sierra_2: Setting Powered False 18:30:56.842557 run create_hlr_db(pid=17185): Terminated: ok {rc=0} 18:30:57.277716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Launched 18:30:57.612431 run osmo-hlr_10.42.42.2(pid=17188): Launched 18:30:57.740054 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:58.284475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Launched 18:30:58.620091 run osmo-stp_10.42.42.5(pid=17191): Launched 18:30:58.749497 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:59.323937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17193): Launched 18:30:59.659742 run osmo-msc_10.42.42.6(pid=17194): Launched 18:30:59.848339 run osmo-stp_10.42.42.5(pid=17191): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] 18:30:59.989847 run osmo-stp_10.42.42.5(pid=17191): stdout: | (launched: 2022-12-13_18:30:58.559218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:00.132090 run osmo-stp_10.42.42.5(pid=17191): stderr: | [0;m[38;5;43m20221213183058747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183058748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183058748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183058748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:00.271566 run osmo-stp_10.42.42.5(pid=17191): stdout: | (launched: 2022-12-13_18:30:58.559218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:00.404839 run osmo-stp_10.42.42.5(pid=17191): stderr: | [0;m[38;5;43m20221213183058747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183058748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183058748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183058748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183058749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:00.564505 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17191): Process ended prematurely: osmo-stp_10.42.42.5(pid=17191) [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 18:31:00.573953 tst handover.py:18: Test FAILED (6.8 sec) 18:31:00.602339 run osmo-hlr_10.42.42.2(pid=17188): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17188)] 18:31:00.655095 run osmo-hlr_10.42.42.2(pid=17188): stdout: | (launched: 2022-12-13_18:30:57.551415) 18:31:00.708336 run osmo-hlr_10.42.42.2(pid=17188): stderr: | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183057747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183057759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183057768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183057768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183057768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:00.782396 run osmo-msc_10.42.42.6(pid=17194): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17194)] 18:31:00.848853 run osmo-msc_10.42.42.6(pid=17194): stdout: | (launched: 2022-12-13_18:30:59.598798) 18:31:00.910761 run osmo-msc_10.42.42.6(pid=17194): stderr: | [0;m[38;5;43m20221213183059917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183059918 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17a9000c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183059918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183059918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183059918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183059918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183059920 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183059921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183059921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183059921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:00.966213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Terminating (SIGTERM) 18:31:01.010530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Terminating (SIGTERM) 18:31:01.056560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17193): Terminating (SIGTERM) 18:31:01.101758 --- ParallelTerminationStrategy: PID 17187 died... 18:31:01.123794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Terminated: ok {rc=0} 18:31:01.173126 --- ParallelTerminationStrategy: PID 17190 died... 18:31:01.194715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Terminated: ok {rc=0} 18:31:01.243568 --- ParallelTerminationStrategy: PID 17193 died... 18:31:01.265210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17193): Terminated: ok {rc=0} 18:31:01.358782 bus /sierra_3: Setting Powered False 18:31:02.461019 bus /sierra_3: Setting Powered False 18:31:03.579296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 18:31:04.821294 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:04.827040 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:31:04.880323 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:31:04.908071 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:31:04.960033 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:31:05.011641 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:31:05.038625 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:31:05.591272 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 18:31:05.597392 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:05.608350 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:31:05.646091 tst handover.py: using LAC 35462 18:31:05.769664 tst handover.py: using RAC 17 18:31:05.890550 tst handover.py: using CellId 35462 18:31:06.012896 tst handover.py: using BVCI 35463 18:31:06.126245 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:31:06.175817 tst handover.py: using LAC 35463 18:31:06.297105 tst handover.py: using RAC 18 18:31:06.416932 tst handover.py: using CellId 35463 18:31:06.537727 tst handover.py: using BVCI 35464 18:31:06.651058 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:06.662057 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:06.672809 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:06.683789 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:06.695197 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:06.706492 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:31:06.831313 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:31:06.954330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:07.439598 run create_hlr_db(pid=17199): Launched 18:31:07.568444 bus /sierra_2: Setting Powered False 18:31:08.634076 run create_hlr_db(pid=17199): Terminated: ok {rc=0} 18:31:09.069271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Launched 18:31:09.403892 run osmo-hlr_10.42.42.2(pid=17202): Launched 18:31:09.531335 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:10.076374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Launched 18:31:10.410946 run osmo-stp_10.42.42.5(pid=17205): Launched 18:31:10.539769 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:11.114088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17207): Launched 18:31:11.447959 run osmo-msc_10.42.42.6(pid=17208): Launched 18:31:11.634145 run osmo-stp_10.42.42.5(pid=17205): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] 18:31:11.774285 run osmo-stp_10.42.42.5(pid=17205): stdout: | (launched: 2022-12-13_18:31:10.350059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:11.915699 run osmo-stp_10.42.42.5(pid=17205): stderr: | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183110540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:12.053831 run osmo-stp_10.42.42.5(pid=17205): stdout: | (launched: 2022-12-13_18:31:10.350059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:12.186176 run osmo-stp_10.42.42.5(pid=17205): stderr: | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183110539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183110540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183110540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:12.344885 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17205): Process ended prematurely: osmo-stp_10.42.42.5(pid=17205) [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 18:31:12.354268 tst handover.py:18: Test FAILED (6.7 sec) 18:31:12.382155 run osmo-hlr_10.42.42.2(pid=17202): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17202)] 18:31:12.434060 run osmo-hlr_10.42.42.2(pid=17202): stdout: | (launched: 2022-12-13_18:31:09.343341) 18:31:12.487094 run osmo-hlr_10.42.42.2(pid=17202): stderr: | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183109537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183109550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183109558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183109559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183109559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:12.561020 run osmo-msc_10.42.42.6(pid=17208): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17208)] 18:31:12.612296 run osmo-msc_10.42.42.6(pid=17208): stdout: | (launched: 2022-12-13_18:31:11.386980) 18:31:12.665308 run osmo-msc_10.42.42.6(pid=17208): stderr: | [0;m[38;5;43m20221213183111707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183111707 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4849b95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183111707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183111707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183111707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183111707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183111709 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183111710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183111710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183111710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:12.718496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Terminating (SIGTERM) 18:31:12.761021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Terminating (SIGTERM) 18:31:12.803616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17207): Terminating (SIGTERM) 18:31:12.846851 --- ParallelTerminationStrategy: PID 17201 died... 18:31:12.867698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Terminated: ok {rc=0} 18:31:12.915404 --- ParallelTerminationStrategy: PID 17204 died... 18:31:12.935427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Terminated: ok {rc=0} 18:31:12.982355 --- ParallelTerminationStrategy: PID 17207 died... 18:31:13.002458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17207): Terminated: ok {rc=0} 18:31:13.091896 bus /sierra_3: Setting Powered False 18:31:14.191996 bus /sierra_3: Setting Powered False 18:31:15.310679 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 18:31:16.570866 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:16.576201 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:31:16.642636 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:31:16.677715 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:31:16.745513 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:31:16.813994 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:31:16.848322 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:31:17.378172 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 18:31:17.384032 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:17.395543 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:31:17.434636 tst handover.py: using LAC 35464 18:31:17.565606 tst handover.py: using RAC 19 18:31:17.696373 tst handover.py: using CellId 35464 18:31:17.824815 tst handover.py: using BVCI 35465 18:31:17.946752 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:31:17.994202 tst handover.py: using LAC 35465 18:31:18.124767 tst handover.py: using RAC 20 18:31:18.257696 tst handover.py: using CellId 35465 18:31:18.386964 tst handover.py: using BVCI 35466 18:31:18.508122 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:18.519625 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:18.531023 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:18.542407 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:18.554469 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:18.566426 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:31:18.690124 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:31:18.811957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:19.299615 run create_hlr_db(pid=17213): Launched 18:31:19.427519 bus /sierra_2: Setting Powered False 18:31:20.493213 run create_hlr_db(pid=17213): Terminated: ok {rc=0} 18:31:20.930003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17215): Launched 18:31:21.265941 run osmo-hlr_10.42.42.2(pid=17216): Launched 18:31:21.394949 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:21.941782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17218): Launched 18:31:22.280054 run osmo-stp_10.42.42.5(pid=17219): Launched 18:31:22.409548 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:22.985839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17221): Launched 18:31:23.323050 run osmo-msc_10.42.42.6(pid=17222): Launched 18:31:23.511159 run osmo-stp_10.42.42.5(pid=17219): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17219)] 18:31:23.652195 run osmo-stp_10.42.42.5(pid=17219): stdout: | (launched: 2022-12-13_18:31:22.219089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:23.793750 run osmo-stp_10.42.42.5(pid=17219): stderr: | [0;m[38;5;43m20221213183122408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183122409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183122409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183122409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:23.933302 run osmo-stp_10.42.42.5(pid=17219): stdout: | (launched: 2022-12-13_18:31:22.219089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:24.066750 run osmo-stp_10.42.42.5(pid=17219): stderr: | [0;m[38;5;43m20221213183122408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183122409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183122409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183122409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183122410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:24.227250 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17219): Process ended prematurely: osmo-stp_10.42.42.5(pid=17219) [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17219)] [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 18:31:24.236476 tst handover.py:18: Test FAILED (6.8 sec) 18:31:24.264850 run osmo-hlr_10.42.42.2(pid=17216): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17216)] 18:31:24.317570 run osmo-hlr_10.42.42.2(pid=17216): stdout: | (launched: 2022-12-13_18:31:21.204820) 18:31:24.371036 run osmo-hlr_10.42.42.2(pid=17216): stderr: | [0;m[1;31m20221213183121401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183121401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183121402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183121402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183121402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183121402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183121428 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183121437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183121438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183121438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:24.445265 run osmo-msc_10.42.42.6(pid=17222): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17222)] 18:31:24.496605 run osmo-msc_10.42.42.6(pid=17222): stdout: | (launched: 2022-12-13_18:31:23.261799) 18:31:24.549777 run osmo-msc_10.42.42.6(pid=17222): stderr: | [0;m[38;5;43m20221213183123581 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183123582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb4f5ba6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183123582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183123582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183123582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183123582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183123584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183123584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183123584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183123584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:24.603416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17215): Terminating (SIGTERM) 18:31:24.646133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17218): Terminating (SIGTERM) 18:31:24.689217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17221): Terminating (SIGTERM) 18:31:24.732328 --- ParallelTerminationStrategy: PID 17215 died... 18:31:24.753226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17215): Terminated: ok {rc=0} 18:31:24.801102 --- ParallelTerminationStrategy: PID 17218 died... 18:31:24.821522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17218): Terminated: ok {rc=0} 18:31:24.869351 --- ParallelTerminationStrategy: PID 17221 died... 18:31:24.889794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17221): Terminated: ok {rc=0} 18:31:24.981212 bus /sierra_3: Setting Powered False 18:31:26.081284 bus /sierra_3: Setting Powered False 18:31:27.201174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 18:31:28.465658 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:28.471507 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:31:28.523479 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:31:28.551030 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:31:28.605609 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:31:28.654923 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:31:28.681635 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:31:29.231436 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 18:31:29.237121 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:29.248109 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:31:29.282397 tst handover.py: using LAC 35466 18:31:29.407768 tst handover.py: using RAC 21 18:31:29.530527 tst handover.py: using CellId 35466 18:31:29.655599 tst handover.py: using BVCI 35467 18:31:29.768459 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:31:29.817319 tst handover.py: using LAC 35467 18:31:29.949732 tst handover.py: using RAC 22 18:31:30.072888 tst handover.py: using CellId 35467 18:31:30.195876 tst handover.py: using BVCI 35468 18:31:30.310024 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:30.320798 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:30.331468 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:30.342092 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:30.353119 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:31:30.363726 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:31:30.480178 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:31:30.599921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:31.084676 run create_hlr_db(pid=17227): Launched 18:31:31.245821 bus /sierra_2: Setting Powered False 18:31:32.313486 run create_hlr_db(pid=17227): Terminated: ok {rc=0} 18:31:32.735458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17229): Launched 18:31:33.049055 run osmo-hlr_10.42.42.2(pid=17230): Launched 18:31:33.167971 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:33.693449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17232): Launched 18:31:34.006409 run osmo-stp_10.42.42.5(pid=17233): Launched 18:31:34.127583 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:34.669082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17235): Launched 18:31:34.983082 run osmo-msc_10.42.42.6(pid=17236): Launched 18:31:35.159324 run osmo-stp_10.42.42.5(pid=17233): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17233)] 18:31:35.292481 run osmo-stp_10.42.42.5(pid=17233): stdout: | (launched: 2022-12-13_18:31:33.948681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:35.424032 run osmo-stp_10.42.42.5(pid=17233): stderr: | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183134116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:35.553826 run osmo-stp_10.42.42.5(pid=17233): stdout: | (launched: 2022-12-13_18:31:33.948681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:35.677921 run osmo-stp_10.42.42.5(pid=17233): stderr: | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183134116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183134116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183134117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:35.826390 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17233): Process ended prematurely: osmo-stp_10.42.42.5(pid=17233) [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17233)] [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 18:31:35.834991 tst handover.py:18: Test FAILED (6.6 sec) 18:31:35.861827 run osmo-hlr_10.42.42.2(pid=17230): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17230)] 18:31:35.910896 run osmo-hlr_10.42.42.2(pid=17230): stdout: | (launched: 2022-12-13_18:31:32.991067) 18:31:35.961111 run osmo-hlr_10.42.42.2(pid=17230): stderr: | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183133166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183133178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183133186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183133187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183133187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:36.030979 run osmo-msc_10.42.42.6(pid=17236): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17236)] 18:31:36.079428 run osmo-msc_10.42.42.6(pid=17236): stdout: | (launched: 2022-12-13_18:31:34.925312) 18:31:36.129389 run osmo-msc_10.42.42.6(pid=17236): stderr: | [0;m[38;5;43m20221213183135197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183135197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3964b8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183135197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183135197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183135197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183135197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183135199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183135199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183135200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183135200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:36.179851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17229): Terminating (SIGTERM) 18:31:36.220171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17232): Terminating (SIGTERM) 18:31:36.260274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17235): Terminating (SIGTERM) 18:31:36.300623 --- ParallelTerminationStrategy: PID 17229 died... 18:31:36.320348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17229): Terminated: ok {rc=0} 18:31:36.365253 --- ParallelTerminationStrategy: PID 17232 died... 18:31:36.384307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17232): Terminated: ok {rc=0} 18:31:36.428933 --- ParallelTerminationStrategy: PID 17235 died... 18:31:36.448033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17235): Terminated: ok {rc=0} 18:31:36.535815 bus /sierra_3: Setting Powered False 18:31:37.637781 bus /sierra_3: Setting Powered False 18:31:38.754164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:31:40.008489 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:40.013824 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:31:40.058791 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:31:40.085365 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:31:40.136454 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:31:40.181670 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:31:40.208103 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:31:40.765085 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:31:40.770999 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:40.782795 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:31:40.819675 tst handover.py: using LAC 35468 18:31:40.944006 tst handover.py: using RAC 23 18:31:41.068149 tst handover.py: using CellId 35468 18:31:41.192274 tst handover.py: using BVCI 35469 18:31:41.305917 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:31:41.350851 tst handover.py: using LAC 35469 18:31:41.475732 tst handover.py: using RAC 24 18:31:41.599705 tst handover.py: using CellId 35469 18:31:41.725223 tst handover.py: using BVCI 35470 18:31:41.839607 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.850776 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.861725 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.872598 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.884146 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.895594 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:31:42.018296 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:31:42.138843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:42.594878 run create_hlr_db(pid=17241): Launched 18:31:42.723348 bus /sierra_2: Setting Powered False 18:31:43.785509 run create_hlr_db(pid=17241): Terminated: ok {rc=0} 18:31:44.213743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17243): Launched 18:31:44.549991 run osmo-hlr_10.42.42.2(pid=17244): Launched 18:31:44.678669 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:45.227205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17246): Launched 18:31:45.562276 run osmo-stp_10.42.42.5(pid=17247): Launched 18:31:45.690219 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:46.269794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17249): Launched 18:31:46.593792 run osmo-msc_10.42.42.6(pid=17250): Launched 18:31:46.990697 run osmo-stp_10.42.42.5(pid=17247): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17247)] 18:31:47.333149 run osmo-stp_10.42.42.5(pid=17247): stdout: | (launched: 2022-12-13_18:31:45.500826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:47.474709 run osmo-stp_10.42.42.5(pid=17247): stderr: | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183145691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:47.614695 run osmo-stp_10.42.42.5(pid=17247): stdout: | (launched: 2022-12-13_18:31:45.500826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:47.747779 run osmo-stp_10.42.42.5(pid=17247): stderr: | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183145691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183145691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183145692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:47.907499 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17247): Process ended prematurely: osmo-stp_10.42.42.5(pid=17247) [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17247)] [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 18:31:47.916810 tst handover.py:18: Test FAILED (7.1 sec) 18:31:47.945262 run osmo-hlr_10.42.42.2(pid=17244): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17244)] 18:31:47.998195 run osmo-hlr_10.42.42.2(pid=17244): stdout: | (launched: 2022-12-13_18:31:44.488130) 18:31:48.052074 run osmo-hlr_10.42.42.2(pid=17244): stderr: | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183144685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183144697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183144705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183144705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183144706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:48.126752 run osmo-msc_10.42.42.6(pid=17250): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17250)] 18:31:48.178644 run osmo-msc_10.42.42.6(pid=17250): stdout: | (launched: 2022-12-13_18:31:46.532523) 18:31:48.232440 run osmo-msc_10.42.42.6(pid=17250): stderr: | [0;m[38;5;43m20221213183147248 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183147248 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78c1ebec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183147248 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183147248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183147249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183147249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183147252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183147253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183147259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183147259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:48.286316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17243): Terminating (SIGTERM) 18:31:48.329178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17246): Terminating (SIGTERM) 18:31:48.372469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17249): Terminating (SIGTERM) 18:31:48.416336 --- ParallelTerminationStrategy: PID 17243 died... 18:31:48.437555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17243): Terminated: ok {rc=0} 18:31:48.485683 --- ParallelTerminationStrategy: PID 17246 died... 18:31:48.506350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17246): Terminated: ok {rc=0} 18:31:48.554731 --- ParallelTerminationStrategy: PID 17249 died... 18:31:48.575485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17249): Terminated: ok {rc=0} 18:31:48.667198 bus /sierra_3: Setting Powered False 18:31:49.768443 bus /sierra_3: Setting Powered False 18:31:50.886179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:31:52.144865 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:52.150740 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:31:52.203097 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:31:52.230753 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:31:52.287052 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:31:52.338346 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:31:52.365493 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:31:52.913838 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:31:52.919214 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:52.930509 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:31:52.964849 tst handover.py: using LAC 35470 18:31:53.089135 tst handover.py: using RAC 25 18:31:53.213273 tst handover.py: using CellId 35470 18:31:53.335643 tst handover.py: using BVCI 35471 18:31:53.450361 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:31:53.501543 tst handover.py: using LAC 35471 18:31:53.625948 tst handover.py: using RAC 26 18:31:53.749729 tst handover.py: using CellId 35471 18:31:53.871740 tst handover.py: using BVCI 35472 18:31:53.986685 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:53.997866 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:54.008608 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:54.019440 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:54.030515 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:54.041445 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:31:54.164855 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:31:54.283269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:54.739719 run create_hlr_db(pid=17255): Launched 18:31:54.866995 bus /sierra_2: Setting Powered False 18:31:55.929162 run create_hlr_db(pid=17255): Terminated: ok {rc=0} 18:31:56.356898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17257): Launched 18:31:56.691498 run osmo-hlr_10.42.42.2(pid=17258): Launched 18:31:56.820516 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:57.369871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17260): Launched 18:31:57.705216 run osmo-stp_10.42.42.5(pid=17261): Launched 18:31:57.834092 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:58.407437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17263): Launched 18:31:58.741547 run osmo-msc_10.42.42.6(pid=17264): Launched 18:31:58.929121 run osmo-stp_10.42.42.5(pid=17261): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17261)] 18:31:59.070176 run osmo-stp_10.42.42.5(pid=17261): stdout: | (launched: 2022-12-13_18:31:57.644199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:59.212495 run osmo-stp_10.42.42.5(pid=17261): stderr: | [0;m[38;5;43m20221213183157835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183157835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183157836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183157836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:59.351733 run osmo-stp_10.42.42.5(pid=17261): stdout: | (launched: 2022-12-13_18:31:57.644199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:59.485345 run osmo-stp_10.42.42.5(pid=17261): stderr: | [0;m[38;5;43m20221213183157835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183157835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183157836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183157836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183157837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:59.644771 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17261): Process ended prematurely: osmo-stp_10.42.42.5(pid=17261) [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17261)] [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 18:31:59.654008 tst handover.py:18: Test FAILED (6.7 sec) 18:31:59.681895 run osmo-hlr_10.42.42.2(pid=17258): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17258)] 18:31:59.733920 run osmo-hlr_10.42.42.2(pid=17258): stdout: | (launched: 2022-12-13_18:31:56.630680) 18:31:59.787697 run osmo-hlr_10.42.42.2(pid=17258): stderr: | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183156826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183156837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183156846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183156846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183156846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:59.862172 run osmo-msc_10.42.42.6(pid=17264): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17264)] 18:31:59.913675 run osmo-msc_10.42.42.6(pid=17264): stdout: | (launched: 2022-12-13_18:31:58.680357) 18:31:59.967208 run osmo-msc_10.42.42.6(pid=17264): stderr: | [0;m[38;5;43m20221213183159000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183159001 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfbc0f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183159001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183159001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183159001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183159001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183159003 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183159003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183159003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183159003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:00.020840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17257): Terminating (SIGTERM) 18:32:00.063435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17260): Terminating (SIGTERM) 18:32:00.106604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17263): Terminating (SIGTERM) 18:32:00.149838 --- ParallelTerminationStrategy: PID 17257 died... 18:32:00.170665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17257): Terminated: ok {rc=0} 18:32:00.218230 --- ParallelTerminationStrategy: PID 17260 died... 18:32:00.238527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17260): Terminated: ok {rc=0} 18:32:00.285898 --- ParallelTerminationStrategy: PID 17263 died... 18:32:00.306208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17263): Terminated: ok {rc=0} 18:32:00.396814 bus /sierra_3: Setting Powered False 18:32:01.494442 bus /sierra_3: Setting Powered False 18:32:02.612070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 18:32:03.871523 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:03.877040 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:32:03.914264 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:32:03.940760 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:32:03.992420 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:32:04.029449 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:32:04.055829 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:32:04.610033 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 18:32:04.616383 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:04.628134 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:04.663490 tst handover.py: using LAC 35472 18:32:04.794379 tst handover.py: using RAC 27 18:32:04.926608 tst handover.py: using CellId 35472 18:32:05.058811 tst handover.py: using BVCI 35473 18:32:05.182000 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:05.217738 tst handover.py: using LAC 35473 18:32:05.349133 tst handover.py: using RAC 28 18:32:05.480732 tst handover.py: using CellId 35473 18:32:05.613108 tst handover.py: using BVCI 35474 18:32:05.735974 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.747201 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.758224 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.769326 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.781227 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.793212 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:05.914184 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:06.036708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:06.524886 run create_hlr_db(pid=17269): Launched 18:32:06.654825 bus /sierra_2: Setting Powered False 18:32:07.720784 run create_hlr_db(pid=17269): Terminated: ok {rc=0} 18:32:08.156823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17271): Launched 18:32:08.492595 run osmo-hlr_10.42.42.2(pid=17272): Launched 18:32:08.620170 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:09.167896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17274): Launched 18:32:09.502833 run osmo-stp_10.42.42.5(pid=17275): Launched 18:32:09.632304 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:10.205674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17277): Launched 18:32:10.541095 run osmo-msc_10.42.42.6(pid=17278): Launched 18:32:10.727401 run osmo-stp_10.42.42.5(pid=17275): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17275)] 18:32:10.867832 run osmo-stp_10.42.42.5(pid=17275): stdout: | (launched: 2022-12-13_18:32:09.442015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:11.009562 run osmo-stp_10.42.42.5(pid=17275): stderr: | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183209633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:11.148666 run osmo-stp_10.42.42.5(pid=17275): stdout: | (launched: 2022-12-13_18:32:09.442015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:11.281641 run osmo-stp_10.42.42.5(pid=17275): stderr: | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183209632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183209633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183209633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:11.440570 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17275): Process ended prematurely: osmo-stp_10.42.42.5(pid=17275) [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17275)] [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 18:32:11.449844 tst handover.py:18: Test FAILED (6.8 sec) 18:32:11.477683 run osmo-hlr_10.42.42.2(pid=17272): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17272)] 18:32:11.529754 run osmo-hlr_10.42.42.2(pid=17272): stdout: | (launched: 2022-12-13_18:32:08.431627) 18:32:11.582999 run osmo-hlr_10.42.42.2(pid=17272): stderr: | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183208628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183208640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183208649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183208649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183208649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:11.657288 run osmo-msc_10.42.42.6(pid=17278): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17278)] 18:32:11.708360 run osmo-msc_10.42.42.6(pid=17278): stdout: | (launched: 2022-12-13_18:32:10.479684) 18:32:11.761377 run osmo-msc_10.42.42.6(pid=17278): stderr: | [0;m[38;5;43m20221213183210801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183210802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbbf41d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183210802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183210802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183210802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183210802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183210804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183210804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183210804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183210805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:11.814461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17271): Terminating (SIGTERM) 18:32:11.856866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17274): Terminating (SIGTERM) 18:32:11.900277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17277): Terminating (SIGTERM) 18:32:11.943489 --- ParallelTerminationStrategy: PID 17271 died... 18:32:11.964208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17271): Terminated: ok {rc=0} 18:32:12.011600 --- ParallelTerminationStrategy: PID 17274 died... 18:32:12.031698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17274): Terminated: ok {rc=0} 18:32:12.078868 --- ParallelTerminationStrategy: PID 17277 died... 18:32:12.099002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17277): Terminated: ok {rc=0} 18:32:12.188612 bus /sierra_3: Setting Powered False 18:32:13.288834 bus /sierra_3: Setting Powered False 18:32:14.407700 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 18:32:15.653169 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:15.659149 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:32:15.711637 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:32:15.739080 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:32:15.793026 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:32:15.858403 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:32:15.889543 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:32:16.419655 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 18:32:16.428317 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:16.440179 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:32:16.474642 tst handover.py: using LAC 35474 18:32:16.643225 tst handover.py: using RAC 29 18:32:16.769000 tst handover.py: using CellId 35474 18:32:16.904468 tst handover.py: using BVCI 35475 18:32:17.058282 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:32:17.115978 tst handover.py: using LAC 35475 18:32:17.268392 tst handover.py: using RAC 30 18:32:17.398852 tst handover.py: using CellId 35475 18:32:17.528877 tst handover.py: using BVCI 35476 18:32:17.645260 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.656264 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.667144 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.677929 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.689101 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.699826 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:32:17.822395 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:32:17.942367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:18.396898 run create_hlr_db(pid=17284): Launched 18:32:18.523662 bus /sierra_2: Setting Powered False 18:32:19.586557 run create_hlr_db(pid=17284): Terminated: ok {rc=0} 18:32:20.014521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17286): Launched 18:32:20.349998 run osmo-hlr_10.42.42.2(pid=17287): Launched 18:32:20.479181 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:21.028365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17289): Launched 18:32:21.362700 run osmo-stp_10.42.42.5(pid=17290): Launched 18:32:21.491741 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:22.071022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17292): Launched 18:32:22.403870 run osmo-msc_10.42.42.6(pid=17293): Launched 18:32:22.592146 run osmo-stp_10.42.42.5(pid=17290): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17290)] 18:32:22.733268 run osmo-stp_10.42.42.5(pid=17290): stdout: | (launched: 2022-12-13_18:32:21.301658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:22.874906 run osmo-stp_10.42.42.5(pid=17290): stderr: | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183221492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:23.014115 run osmo-stp_10.42.42.5(pid=17290): stdout: | (launched: 2022-12-13_18:32:21.301658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:23.147053 run osmo-stp_10.42.42.5(pid=17290): stderr: | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183221491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183221492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183221492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:23.305973 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17290): Process ended prematurely: osmo-stp_10.42.42.5(pid=17290) [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17290)] [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 18:32:23.315016 tst handover.py:18: Test FAILED (6.9 sec) 18:32:23.342978 run osmo-hlr_10.42.42.2(pid=17287): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17287)] 18:32:23.395019 run osmo-hlr_10.42.42.2(pid=17287): stdout: | (launched: 2022-12-13_18:32:20.289227) 18:32:23.447999 run osmo-hlr_10.42.42.2(pid=17287): stderr: | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183220486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183220500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183220510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183220510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183220510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:23.521995 run osmo-msc_10.42.42.6(pid=17293): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17293)] 18:32:23.573359 run osmo-msc_10.42.42.6(pid=17293): stdout: | (launched: 2022-12-13_18:32:22.342986) 18:32:23.626402 run osmo-msc_10.42.42.6(pid=17293): stderr: | [0;m[38;5;43m20221213183222661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183222661 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15fb887c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183222661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183222661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183222662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183222662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183222664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183222664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183222664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183222664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:23.680070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17286): Terminating (SIGTERM) 18:32:23.722751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17289): Terminating (SIGTERM) 18:32:23.765884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17292): Terminating (SIGTERM) 18:32:23.809163 --- ParallelTerminationStrategy: PID 17286 died... 18:32:23.830039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17286): Terminated: ok {rc=0} 18:32:23.877584 --- ParallelTerminationStrategy: PID 17289 died... 18:32:23.898109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17289): Terminated: ok {rc=0} 18:32:23.945824 --- ParallelTerminationStrategy: PID 17292 died... 18:32:23.966184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17292): Terminated: ok {rc=0} 18:32:24.057413 bus /sierra_3: Setting Powered False 18:32:25.157746 bus /sierra_3: Setting Powered False 18:32:26.277168 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 18:32:27.538013 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:27.543541 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:32:27.594555 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:32:27.622398 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:32:27.675038 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:32:27.725496 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:32:27.753103 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:32:28.305114 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 18:32:28.311483 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:28.323312 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:32:28.361650 tst handover.py: using LAC 35476 18:32:28.492251 tst handover.py: using RAC 31 18:32:28.623301 tst handover.py: using CellId 35476 18:32:28.752685 tst handover.py: using BVCI 35477 18:32:28.875017 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:32:28.922179 tst handover.py: using LAC 35477 18:32:29.051344 tst handover.py: using RAC 32 18:32:29.183398 tst handover.py: using CellId 35477 18:32:29.313855 tst handover.py: using BVCI 35478 18:32:29.437631 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.449213 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.460302 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.471593 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.483267 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.494883 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:32:29.614848 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:32:29.735506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:30.192203 run create_hlr_db(pid=17299): Launched 18:32:30.321478 bus /sierra_2: Setting Powered False 18:32:31.384192 run create_hlr_db(pid=17299): Terminated: ok {rc=0} 18:32:31.842613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17301): Launched 18:32:32.181335 run osmo-hlr_10.42.42.2(pid=17302): Launched 18:32:32.320852 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:32.831272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17304): Launched 18:32:33.144513 run osmo-stp_10.42.42.5(pid=17305): Launched 18:32:33.263736 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:33.803342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17307): Launched 18:32:34.115872 run osmo-msc_10.42.42.6(pid=17308): Launched 18:32:34.290247 run osmo-stp_10.42.42.5(pid=17305): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17305)] 18:32:34.421631 run osmo-stp_10.42.42.5(pid=17305): stdout: | (launched: 2022-12-13_18:32:33.086964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:34.552736 run osmo-stp_10.42.42.5(pid=17305): stderr: | [0;m[38;5;43m20221213183233256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183233256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183233257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183233257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:34.682049 run osmo-stp_10.42.42.5(pid=17305): stdout: | (launched: 2022-12-13_18:32:33.086964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:34.805976 run osmo-stp_10.42.42.5(pid=17305): stderr: | [0;m[38;5;43m20221213183233256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183233256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183233257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183233257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183233258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:34.954688 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17305): Process ended prematurely: osmo-stp_10.42.42.5(pid=17305) [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17305)] [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 18:32:34.963058 tst handover.py:18: Test FAILED (6.6 sec) 18:32:34.989455 run osmo-hlr_10.42.42.2(pid=17302): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17302)] 18:32:35.037900 run osmo-hlr_10.42.42.2(pid=17302): stdout: | (launched: 2022-12-13_18:32:32.115228) 18:32:35.088005 run osmo-hlr_10.42.42.2(pid=17302): stderr: | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183232318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183232329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183232337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183232337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183232337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:35.158138 run osmo-msc_10.42.42.6(pid=17308): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17308)] 18:32:35.206624 run osmo-msc_10.42.42.6(pid=17308): stdout: | (launched: 2022-12-13_18:32:34.058177) 18:32:35.256711 run osmo-msc_10.42.42.6(pid=17308): stderr: | [0;m[38;5;43m20221213183234330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183234330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ee4919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183234330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183234330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183234330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183234330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183234332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183234333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183234333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183234333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:35.307175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17301): Terminating (SIGTERM) 18:32:35.347482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17304): Terminating (SIGTERM) 18:32:35.388409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17307): Terminating (SIGTERM) 18:32:35.429028 --- ParallelTerminationStrategy: PID 17301 died... 18:32:35.448490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17301): Terminated: ok {rc=0} 18:32:35.492938 --- ParallelTerminationStrategy: PID 17304 died... 18:32:35.512034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17304): Terminated: ok {rc=0} 18:32:35.556562 --- ParallelTerminationStrategy: PID 17307 died... 18:32:35.575522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17307): Terminated: ok {rc=0} 18:32:35.663378 bus /sierra_3: Setting Powered False 18:32:36.763962 bus /sierra_3: Setting Powered False 18:32:37.882599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:32:39.140452 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:39.145641 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:32:39.204295 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:32:39.230829 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:32:39.284240 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:32:39.347866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:32:39.375121 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:32:39.919267 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:32:39.924807 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:39.936146 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:32:39.983954 tst handover.py: using LAC 35478 18:32:40.107051 tst handover.py: using RAC 33 18:32:40.234949 tst handover.py: using CellId 35478 18:32:40.356712 tst handover.py: using BVCI 35479 18:32:40.469996 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:32:40.512673 tst handover.py: using LAC 35479 18:32:40.633447 tst handover.py: using RAC 34 18:32:40.755911 tst handover.py: using CellId 35479 18:32:40.877087 tst handover.py: using BVCI 35480 18:32:40.990581 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:41.001745 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:41.012612 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:41.023671 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:41.034690 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:32:41.045630 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:32:41.166924 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:32:41.285602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:41.741638 run create_hlr_db(pid=17313): Launched 18:32:41.869190 bus /sierra_2: Setting Powered False 18:32:42.931282 run create_hlr_db(pid=17313): Terminated: ok {rc=0} 18:32:43.358979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17315): Launched 18:32:43.695088 run osmo-hlr_10.42.42.2(pid=17316): Launched 18:32:43.824677 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:44.369896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17318): Launched 18:32:44.704889 run osmo-stp_10.42.42.5(pid=17319): Launched 18:32:44.834459 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:45.412246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17321): Launched 18:32:45.748094 run osmo-msc_10.42.42.6(pid=17322): Launched 18:32:46.014820 run osmo-stp_10.42.42.5(pid=17319): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17319)] 18:32:46.289411 run osmo-stp_10.42.42.5(pid=17319): stdout: | (launched: 2022-12-13_18:32:44.643758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:46.540741 run osmo-stp_10.42.42.5(pid=17319): stderr: | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183244835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:46.676916 run osmo-stp_10.42.42.5(pid=17319): stdout: | (launched: 2022-12-13_18:32:44.643758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:46.806875 run osmo-stp_10.42.42.5(pid=17319): stderr: | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183244834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183244835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183244835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:46.960038 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17319): Process ended prematurely: osmo-stp_10.42.42.5(pid=17319) [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17319)] [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 18:32:46.969385 tst handover.py:18: Test FAILED (7.0 sec) 18:32:46.998309 run osmo-hlr_10.42.42.2(pid=17316): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17316)] 18:32:47.050284 run osmo-hlr_10.42.42.2(pid=17316): stdout: | (launched: 2022-12-13_18:32:43.633973) 18:32:47.103247 run osmo-hlr_10.42.42.2(pid=17316): stderr: | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183243831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183243864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183243874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183243874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183243874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:47.177258 run osmo-msc_10.42.42.6(pid=17322): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17322)] 18:32:47.229341 run osmo-msc_10.42.42.6(pid=17322): stdout: | (launched: 2022-12-13_18:32:45.687163) 18:32:47.281748 run osmo-msc_10.42.42.6(pid=17322): stderr: | [0;m[38;5;43m20221213183246245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183246247 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2d981bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183246247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183246247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183246249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183246251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183246261 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183246263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183246264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183246264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:47.335441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17315): Terminating (SIGTERM) 18:32:47.377658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17318): Terminating (SIGTERM) 18:32:47.418996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17321): Terminating (SIGTERM) 18:32:47.460405 --- ParallelTerminationStrategy: PID 17315 died... 18:32:47.480571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17315): Terminated: ok {rc=0} 18:32:47.526302 --- ParallelTerminationStrategy: PID 17318 died... 18:32:47.545922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17318): Terminated: ok {rc=0} 18:32:47.591895 --- ParallelTerminationStrategy: PID 17321 died... 18:32:47.611980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17321): Terminated: ok {rc=0} 18:32:47.700602 bus /sierra_3: Setting Powered False 18:32:48.803143 bus /sierra_3: Setting Powered False 18:32:49.921793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:32:51.190911 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:51.196207 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:32:51.262508 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:32:51.290080 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:32:51.343946 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:32:51.410403 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:32:51.437968 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:32:51.989862 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:32:51.995587 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:52.007199 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:32:52.056821 tst handover.py: using LAC 35480 18:32:52.187465 tst handover.py: using RAC 35 18:32:52.316268 tst handover.py: using CellId 35480 18:32:52.445892 tst handover.py: using BVCI 35481 18:32:52.568381 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:32:52.618733 tst handover.py: using LAC 35481 18:32:52.750757 tst handover.py: using RAC 36 18:32:52.881755 tst handover.py: using CellId 35481 18:32:53.012518 tst handover.py: using BVCI 35482 18:32:53.125591 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:53.136698 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:53.147683 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:53.158585 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:53.169556 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:53.180387 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:32:53.302546 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:32:53.423091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:53.879298 run create_hlr_db(pid=17327): Launched 18:32:54.006763 bus /sierra_2: Setting Powered False 18:32:55.068398 run create_hlr_db(pid=17327): Terminated: ok {rc=0} 18:32:55.475804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17329): Launched 18:32:55.788905 run osmo-hlr_10.42.42.2(pid=17330): Launched 18:32:55.908027 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:56.433371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17332): Launched 18:32:56.743366 run osmo-stp_10.42.42.5(pid=17333): Launched 18:32:56.861502 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:57.397576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17335): Launched 18:32:57.709636 run osmo-msc_10.42.42.6(pid=17336): Launched 18:32:57.882827 run osmo-stp_10.42.42.5(pid=17333): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17333)] 18:32:58.014707 run osmo-stp_10.42.42.5(pid=17333): stdout: | (launched: 2022-12-13_18:32:56.686381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.145678 run osmo-stp_10.42.42.5(pid=17333): stderr: | [0;m[38;5;43m20221213183256854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183256855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183256855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183256855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.274914 run osmo-stp_10.42.42.5(pid=17333): stdout: | (launched: 2022-12-13_18:32:56.686381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.398823 run osmo-stp_10.42.42.5(pid=17333): stderr: | [0;m[38;5;43m20221213183256854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183256855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183256855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183256855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183256856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.546605 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17333): Process ended prematurely: osmo-stp_10.42.42.5(pid=17333) [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17333)] [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 18:32:58.555146 tst handover.py:18: Test FAILED (6.6 sec) 18:32:58.581736 run osmo-hlr_10.42.42.2(pid=17330): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17330)] 18:32:58.630254 run osmo-hlr_10.42.42.2(pid=17330): stdout: | (launched: 2022-12-13_18:32:55.731525) 18:32:58.680262 run osmo-hlr_10.42.42.2(pid=17330): stderr: | [0;m[1;31m20221213183255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183255906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183255907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183255919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183255927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183255927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183255927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:58.749948 run osmo-msc_10.42.42.6(pid=17336): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17336)] 18:32:58.798093 run osmo-msc_10.42.42.6(pid=17336): stdout: | (launched: 2022-12-13_18:32:57.652051) 18:32:58.848137 run osmo-msc_10.42.42.6(pid=17336): stderr: | [0;m[38;5;43m20221213183257925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183257925 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb5fa73cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183257925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183257925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183257925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183257926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183257927 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183257928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183257928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183257928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:58.898136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17329): Terminating (SIGTERM) 18:32:58.938097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17332): Terminating (SIGTERM) 18:32:58.978740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17335): Terminating (SIGTERM) 18:32:59.019112 --- ParallelTerminationStrategy: PID 17329 died... 18:32:59.038427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17329): Terminated: ok {rc=0} 18:32:59.082754 --- ParallelTerminationStrategy: PID 17332 died... 18:32:59.101548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17332): Terminated: ok {rc=0} 18:32:59.145695 --- ParallelTerminationStrategy: PID 17335 died... 18:32:59.164346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17335): Terminated: ok {rc=0} 18:32:59.251221 bus /sierra_3: Setting Powered False 18:33:00.352851 bus /sierra_3: Setting Powered False 18:33:01.476472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 18:33:02.758114 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:02.763960 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:33:02.816502 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:33:02.844744 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:33:02.896904 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:33:02.950370 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:33:02.977762 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:33:03.530566 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 18:33:03.536311 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:03.547855 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:03.597916 tst handover.py: using LAC 35482 18:33:03.727030 tst handover.py: using RAC 37 18:33:03.856229 tst handover.py: using CellId 35482 18:33:03.987510 tst handover.py: using BVCI 35483 18:33:04.109092 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:04.143508 tst handover.py: using LAC 35483 18:33:04.272854 tst handover.py: using RAC 38 18:33:04.401984 tst handover.py: using CellId 35483 18:33:04.531041 tst handover.py: using BVCI 35484 18:33:04.652485 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:04.663853 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:04.675138 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:04.686444 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:04.698704 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:04.711057 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:04.831033 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:04.955502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:05.443514 run create_hlr_db(pid=17342): Launched 18:33:05.571253 bus /sierra_2: Setting Powered False 18:33:06.636691 run create_hlr_db(pid=17342): Terminated: ok {rc=0} 18:33:07.056804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17344): Launched 18:33:07.368448 run osmo-hlr_10.42.42.2(pid=17345): Launched 18:33:07.487511 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:07.999815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17347): Launched 18:33:08.311812 run osmo-stp_10.42.42.5(pid=17348): Launched 18:33:08.430688 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:08.967739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17350): Launched 18:33:09.279933 run osmo-msc_10.42.42.6(pid=17351): Launched 18:33:09.453159 run osmo-stp_10.42.42.5(pid=17348): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17348)] 18:33:09.584062 run osmo-stp_10.42.42.5(pid=17348): stdout: | (launched: 2022-12-13_18:33:08.254478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:09.715078 run osmo-stp_10.42.42.5(pid=17348): stderr: | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183308424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183308424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183308424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183308425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:09.843867 run osmo-stp_10.42.42.5(pid=17348): stdout: | (launched: 2022-12-13_18:33:08.254478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:09.967339 run osmo-stp_10.42.42.5(pid=17348): stderr: | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183308423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183308424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183308424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183308424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183308425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:10.115606 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17348): Process ended prematurely: osmo-stp_10.42.42.5(pid=17348) [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17348)] [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 18:33:10.124265 tst handover.py:18: Test FAILED (6.6 sec) 18:33:10.150964 run osmo-hlr_10.42.42.2(pid=17345): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17345)] 18:33:10.199897 run osmo-hlr_10.42.42.2(pid=17345): stdout: | (launched: 2022-12-13_18:33:07.311081) 18:33:10.250397 run osmo-hlr_10.42.42.2(pid=17345): stderr: | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183307489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183307502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183307513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183307513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183307513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:10.321310 run osmo-msc_10.42.42.6(pid=17351): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17351)] 18:33:10.369881 run osmo-msc_10.42.42.6(pid=17351): stdout: | (launched: 2022-12-13_18:33:09.222511) 18:33:10.419901 run osmo-msc_10.42.42.6(pid=17351): stderr: | [0;m[38;5;43m20221213183309493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183309493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ce9399c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183309494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183309494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183309494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183309494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183309496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183309496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183309496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183309496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:10.470090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17344): Terminating (SIGTERM) 18:33:10.510382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17347): Terminating (SIGTERM) 18:33:10.551179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17350): Terminating (SIGTERM) 18:33:10.592281 --- ParallelTerminationStrategy: PID 17344 died... 18:33:10.611946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17344): Terminated: ok {rc=0} 18:33:10.656865 --- ParallelTerminationStrategy: PID 17347 died... 18:33:10.676312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17347): Terminated: ok {rc=0} 18:33:10.720932 --- ParallelTerminationStrategy: PID 17350 died... 18:33:10.740000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17350): Terminated: ok {rc=0} 18:33:10.825758 bus /sierra_3: Setting Powered False 18:33:11.926774 bus /sierra_3: Setting Powered False 18:33:13.045473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 18:33:14.306619 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:14.312270 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:33:14.377840 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:33:14.405305 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:33:14.460052 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:33:14.526957 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:33:14.554519 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:33:15.102786 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 18:33:15.108738 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:15.120256 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:15.170708 tst handover.py: using LAC 35484 18:33:15.302672 tst handover.py: using RAC 39 18:33:15.434646 tst handover.py: using CellId 35484 18:33:15.565781 tst handover.py: using BVCI 35485 18:33:15.686481 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:15.735364 tst handover.py: using LAC 35485 18:33:15.897309 tst handover.py: using RAC 40 18:33:16.027472 tst handover.py: using CellId 35485 18:33:16.190878 tst handover.py: using BVCI 35486 18:33:16.311632 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:16.324297 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:16.336182 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:16.348292 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:16.361167 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:16.373766 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:16.497663 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:16.638928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:17.132176 run create_hlr_db(pid=17356): Launched 18:33:17.263512 bus /sierra_2: Setting Powered False 18:33:18.328682 run create_hlr_db(pid=17356): Terminated: ok {rc=0} 18:33:18.764517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Launched 18:33:19.100669 run osmo-hlr_10.42.42.2(pid=17359): Launched 18:33:19.227942 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:19.775261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Launched 18:33:20.110362 run osmo-stp_10.42.42.5(pid=17362): Launched 18:33:20.239193 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:20.817499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Launched 18:33:21.155760 run osmo-msc_10.42.42.6(pid=17365): Launched 18:33:21.343673 run osmo-stp_10.42.42.5(pid=17362): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] 18:33:21.484464 run osmo-stp_10.42.42.5(pid=17362): stdout: | (launched: 2022-12-13_18:33:20.048718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:21.628392 run osmo-stp_10.42.42.5(pid=17362): stderr: | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183320241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:21.767786 run osmo-stp_10.42.42.5(pid=17362): stdout: | (launched: 2022-12-13_18:33:20.048718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:21.901254 run osmo-stp_10.42.42.5(pid=17362): stderr: | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183320240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183320241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183320241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:22.061405 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17362): Process ended prematurely: osmo-stp_10.42.42.5(pid=17362) [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 18:33:22.070655 tst handover.py:18: Test FAILED (7.0 sec) 18:33:22.098813 run osmo-hlr_10.42.42.2(pid=17359): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17359)] 18:33:22.151028 run osmo-hlr_10.42.42.2(pid=17359): stdout: | (launched: 2022-12-13_18:33:19.039636) 18:33:22.204475 run osmo-hlr_10.42.42.2(pid=17359): stderr: | [0;m[1;31m20221213183319236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183319236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183319236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183319237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183319237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183319237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183319249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183319257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183319258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183319258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:22.278505 run osmo-msc_10.42.42.6(pid=17365): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17365)] 18:33:22.329303 run osmo-msc_10.42.42.6(pid=17365): stdout: | (launched: 2022-12-13_18:33:21.094171) 18:33:22.382483 run osmo-msc_10.42.42.6(pid=17365): stderr: | [0;m[38;5;43m20221213183321416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183321417 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd78277fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183321417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183321417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183321417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183321417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183321419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183321420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183321420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183321420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:22.436010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Terminating (SIGTERM) 18:33:22.478639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Terminating (SIGTERM) 18:33:22.522564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Terminating (SIGTERM) 18:33:22.566420 --- ParallelTerminationStrategy: PID 17358 died... 18:33:22.587498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Terminated: ok {rc=0} 18:33:22.635261 --- ParallelTerminationStrategy: PID 17361 died... 18:33:22.655707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Terminated: ok {rc=0} 18:33:22.703264 --- ParallelTerminationStrategy: PID 17364 died... 18:33:22.723788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Terminated: ok {rc=0} 18:33:22.814861 bus /sierra_3: Setting Powered False 18:33:23.917997 bus /sierra_3: Setting Powered False 18:33:25.038899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 18:33:26.314492 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:26.321230 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:33:26.384907 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:33:26.411632 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:33:26.464099 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:33:26.527745 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:33:26.554888 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:33:27.102770 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 18:33:27.108937 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:27.120358 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:27.167862 tst handover.py: using LAC 35486 18:33:27.290545 tst handover.py: using RAC 41 18:33:27.413411 tst handover.py: using CellId 35486 18:33:27.535978 tst handover.py: using BVCI 35487 18:33:27.650038 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:27.698037 tst handover.py: using LAC 35487 18:33:27.821153 tst handover.py: using RAC 42 18:33:27.944093 tst handover.py: using CellId 35487 18:33:28.066101 tst handover.py: using BVCI 35488 18:33:28.181318 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:28.192123 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:28.202822 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:28.213565 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:28.224232 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:28.234903 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:28.357948 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:28.479983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:28.967079 run create_hlr_db(pid=17370): Launched 18:33:29.096296 bus /sierra_2: Setting Powered False 18:33:30.161328 run create_hlr_db(pid=17370): Terminated: ok {rc=0} 18:33:30.597490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Launched 18:33:30.958314 run osmo-hlr_10.42.42.2(pid=17373): Launched 18:33:31.133692 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:31.817494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Launched 18:33:32.201486 run osmo-stp_10.42.42.5(pid=17376): Launched 18:33:32.406393 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:32.943084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Launched 18:33:33.257377 run osmo-msc_10.42.42.6(pid=17379): Launched 18:33:33.431525 run osmo-stp_10.42.42.5(pid=17376): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] 18:33:33.562702 run osmo-stp_10.42.42.5(pid=17376): stdout: | (launched: 2022-12-13_18:33:32.137062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:33.692773 run osmo-stp_10.42.42.5(pid=17376): stderr: | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183332400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:33.822415 run osmo-stp_10.42.42.5(pid=17376): stdout: | (launched: 2022-12-13_18:33:32.137062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:33.946235 run osmo-stp_10.42.42.5(pid=17376): stderr: | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183332400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183332400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183332401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:34.094899 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17376): Process ended prematurely: osmo-stp_10.42.42.5(pid=17376) [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 18:33:34.103575 tst handover.py:18: Test FAILED (7.0 sec) 18:33:34.130331 run osmo-hlr_10.42.42.2(pid=17373): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17373)] 18:33:34.179678 run osmo-hlr_10.42.42.2(pid=17373): stdout: | (launched: 2022-12-13_18:33:30.888640) 18:33:34.231093 run osmo-hlr_10.42.42.2(pid=17373): stderr: | [0;m[1;31m20221213183331248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183331248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183331248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183331248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183331248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183331249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183331265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183331282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183331282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183331282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:34.302003 run osmo-msc_10.42.42.6(pid=17379): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17379)] 18:33:34.350790 run osmo-msc_10.42.42.6(pid=17379): stdout: | (launched: 2022-12-13_18:33:33.197885) 18:33:34.401106 run osmo-msc_10.42.42.6(pid=17379): stderr: | [0;m[38;5;43m20221213183333472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183333472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad06ef7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183333473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183333473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183333473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183333473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183333475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183333475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183333475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183333475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:34.451891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Terminating (SIGTERM) 18:33:34.492625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Terminating (SIGTERM) 18:33:34.533303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Terminating (SIGTERM) 18:33:34.574405 --- ParallelTerminationStrategy: PID 17372 died... 18:33:34.594246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Terminated: ok {rc=0} 18:33:34.639432 --- ParallelTerminationStrategy: PID 17375 died... 18:33:34.658378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Terminated: ok {rc=0} 18:33:34.703391 --- ParallelTerminationStrategy: PID 17378 died... 18:33:34.722475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Terminated: ok {rc=0} 18:33:34.810644 bus /sierra_3: Setting Powered False 18:33:35.912110 bus /sierra_3: Setting Powered False 18:33:37.030102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:33:38.304733 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:38.310359 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:33:38.370220 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:33:38.396877 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:33:38.447224 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:33:38.508780 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:33:38.535689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:33:39.089553 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:33:39.095063 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:39.106515 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:33:39.151768 tst handover.py: using LAC 35488 18:33:39.282373 tst handover.py: using RAC 43 18:33:39.411583 tst handover.py: using CellId 35488 18:33:39.542620 tst handover.py: using BVCI 35489 18:33:39.665982 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:33:39.715686 tst handover.py: using LAC 35489 18:33:39.846380 tst handover.py: using RAC 44 18:33:39.977190 tst handover.py: using CellId 35489 18:33:40.106291 tst handover.py: using BVCI 35490 18:33:40.220524 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:40.232088 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:40.243585 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:40.255005 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:40.266905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:33:40.278710 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:33:40.402553 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:33:40.525300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:41.012614 run create_hlr_db(pid=17384): Launched 18:33:41.140358 bus /sierra_2: Setting Powered False 18:33:42.203077 run create_hlr_db(pid=17384): Terminated: ok {rc=0} 18:33:42.629576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17386): Launched 18:33:42.965562 run osmo-hlr_10.42.42.2(pid=17387): Launched 18:33:43.093812 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:43.642936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17389): Launched 18:33:43.977792 run osmo-stp_10.42.42.5(pid=17390): Launched 18:33:44.106745 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:44.685374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17392): Launched 18:33:45.019140 run osmo-msc_10.42.42.6(pid=17393): Launched 18:33:45.204401 run osmo-stp_10.42.42.5(pid=17390): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17390)] 18:33:45.345158 run osmo-stp_10.42.42.5(pid=17390): stdout: | (launched: 2022-12-13_18:33:43.915777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:45.485960 run osmo-stp_10.42.42.5(pid=17390): stderr: | [0;m[38;5;43m20221213183344107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183344108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183344108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183344108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:45.624533 run osmo-stp_10.42.42.5(pid=17390): stdout: | (launched: 2022-12-13_18:33:43.915777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:45.757219 run osmo-stp_10.42.42.5(pid=17390): stderr: | [0;m[38;5;43m20221213183344107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183344108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183344108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183344108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183344109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:45.941187 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17390): Process ended prematurely: osmo-stp_10.42.42.5(pid=17390) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17390)] [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 18:33:45.950527 tst handover.py:18: Test FAILED (6.8 sec) 18:33:45.978703 run osmo-hlr_10.42.42.2(pid=17387): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17387)] 18:33:46.030271 run osmo-hlr_10.42.42.2(pid=17387): stdout: | (launched: 2022-12-13_18:33:42.903836) 18:33:46.082266 run osmo-hlr_10.42.42.2(pid=17387): stderr: | [0;m[1;31m20221213183343101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183343102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183343102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183343102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183343102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183343102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183343114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183343125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183343125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183343125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:46.153630 run osmo-msc_10.42.42.6(pid=17393): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17393)] 18:33:46.204013 run osmo-msc_10.42.42.6(pid=17393): stdout: | (launched: 2022-12-13_18:33:44.957547) 18:33:46.256579 run osmo-msc_10.42.42.6(pid=17393): stderr: | [0;m[38;5;43m20221213183345276 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183345276 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fadfd6fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183345276 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183345277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183345277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183345277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183345279 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183345279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183345279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183345279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:46.309316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17386): Terminating (SIGTERM) 18:33:46.352151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17389): Terminating (SIGTERM) 18:33:46.395591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17392): Terminating (SIGTERM) 18:33:46.441082 --- ParallelTerminationStrategy: PID 17386 died... 18:33:46.461139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17386): Terminated: ok {rc=0} 18:33:46.508685 --- ParallelTerminationStrategy: PID 17389 died... 18:33:46.528731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17389): Terminated: ok {rc=0} 18:33:46.574808 --- ParallelTerminationStrategy: PID 17392 died... 18:33:46.594996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17392): Terminated: ok {rc=0} 18:33:46.683316 bus /sierra_3: Setting Powered False 18:33:47.781731 bus /sierra_3: Setting Powered False 18:33:48.898338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 18:33:50.176739 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:50.182581 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:33:50.232024 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:33:50.259587 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:33:50.315405 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:33:50.363436 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:33:50.389966 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:33:50.939013 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 18:33:50.944502 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:50.955675 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:51.002444 tst handover.py: using LAC 35490 18:33:51.123899 tst handover.py: using RAC 45 18:33:51.243856 tst handover.py: using CellId 35490 18:33:51.363886 tst handover.py: using BVCI 35491 18:33:51.476055 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:51.510289 tst handover.py: using LAC 35491 18:33:51.630329 tst handover.py: using RAC 46 18:33:51.749615 tst handover.py: using CellId 35491 18:33:51.869097 tst handover.py: using BVCI 35492 18:33:51.980903 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:51.991992 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:52.002796 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:52.013724 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:52.024626 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:52.035594 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:52.157818 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:52.276649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:52.731341 run create_hlr_db(pid=17398): Launched 18:33:52.858072 bus /sierra_2: Setting Powered False 18:33:53.920432 run create_hlr_db(pid=17398): Terminated: ok {rc=0} 18:33:54.327758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Launched 18:33:54.640001 run osmo-hlr_10.42.42.2(pid=17401): Launched 18:33:54.758584 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:55.266301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Launched 18:33:55.578834 run osmo-stp_10.42.42.5(pid=17404): Launched 18:33:55.697335 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:56.233535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17406): Launched 18:33:56.547952 run osmo-msc_10.42.42.6(pid=17407): Launched 18:33:56.722312 run osmo-stp_10.42.42.5(pid=17404): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] 18:33:56.853767 run osmo-stp_10.42.42.5(pid=17404): stdout: | (launched: 2022-12-13_18:33:55.520352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:56.984825 run osmo-stp_10.42.42.5(pid=17404): stderr: | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183355692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183355693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:57.114416 run osmo-stp_10.42.42.5(pid=17404): stdout: | (launched: 2022-12-13_18:33:55.520352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:57.238304 run osmo-stp_10.42.42.5(pid=17404): stderr: | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183355691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183355692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183355693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:57.386491 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17404): Process ended prematurely: osmo-stp_10.42.42.5(pid=17404) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 18:33:57.395050 tst handover.py:18: Test FAILED (6.4 sec) 18:33:57.421801 run osmo-hlr_10.42.42.2(pid=17401): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17401)] 18:33:57.470397 run osmo-hlr_10.42.42.2(pid=17401): stdout: | (launched: 2022-12-13_18:33:54.582343) 18:33:57.520723 run osmo-hlr_10.42.42.2(pid=17401): stderr: | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183354756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183354769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183354778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183354778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183354778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:57.590800 run osmo-msc_10.42.42.6(pid=17407): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17407)] 18:33:57.638886 run osmo-msc_10.42.42.6(pid=17407): stdout: | (launched: 2022-12-13_18:33:56.489842) 18:33:57.688813 run osmo-msc_10.42.42.6(pid=17407): stderr: | [0;m[38;5;43m20221213183356780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183356780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfecb7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183356780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183356780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183356780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183356781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183356782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183356783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183356783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183356783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:57.739306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Terminating (SIGTERM) 18:33:57.779409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Terminating (SIGTERM) 18:33:57.819700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17406): Terminating (SIGTERM) 18:33:57.860283 --- ParallelTerminationStrategy: PID 17400 died... 18:33:57.879991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Terminated: ok {rc=0} 18:33:57.924884 --- ParallelTerminationStrategy: PID 17403 died... 18:33:57.944499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Terminated: ok {rc=0} 18:33:57.989265 --- ParallelTerminationStrategy: PID 17406 died... 18:33:58.008395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17406): Terminated: ok {rc=0} 18:33:58.096236 bus /sierra_3: Setting Powered False 18:33:59.197391 bus /sierra_3: Setting Powered False 18:34:00.315330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 18:34:01.583957 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:01.590934 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:34:01.658552 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:34:01.686681 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:34:01.740113 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:34:01.814031 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:34:01.848623 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:34:02.383079 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 18:34:02.388844 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:02.400913 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:02.446035 tst handover.py: using LAC 35492 18:34:02.576714 tst handover.py: using RAC 47 18:34:02.709137 tst handover.py: using CellId 35492 18:34:02.839038 tst handover.py: using BVCI 35493 18:34:02.960392 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:03.008568 tst handover.py: using LAC 35493 18:34:03.129893 tst handover.py: using RAC 48 18:34:03.253034 tst handover.py: using CellId 35493 18:34:03.373954 tst handover.py: using BVCI 35494 18:34:03.485969 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.497236 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.508246 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.519253 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.530212 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.541012 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:03.662738 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:03.783214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:04.240743 run create_hlr_db(pid=17413): Launched 18:34:04.367395 bus /sierra_2: Setting Powered False 18:34:05.429199 run create_hlr_db(pid=17413): Terminated: ok {rc=0} 18:34:05.856225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17415): Launched 18:34:06.192041 run osmo-hlr_10.42.42.2(pid=17416): Launched 18:34:06.319812 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:06.864506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17418): Launched 18:34:07.199362 run osmo-stp_10.42.42.5(pid=17419): Launched 18:34:07.327115 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:07.901458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17421): Launched 18:34:08.238257 run osmo-msc_10.42.42.6(pid=17422): Launched 18:34:08.424497 run osmo-stp_10.42.42.5(pid=17419): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17419)] 18:34:08.564676 run osmo-stp_10.42.42.5(pid=17419): stdout: | (launched: 2022-12-13_18:34:07.137868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:08.705428 run osmo-stp_10.42.42.5(pid=17419): stderr: | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183407330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:08.844036 run osmo-stp_10.42.42.5(pid=17419): stdout: | (launched: 2022-12-13_18:34:07.137868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:08.976810 run osmo-stp_10.42.42.5(pid=17419): stderr: | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183407329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183407330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183407330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:09.136114 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17419): Process ended prematurely: osmo-stp_10.42.42.5(pid=17419) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17419)] [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 18:34:09.145228 tst handover.py:18: Test FAILED (6.7 sec) 18:34:09.173231 run osmo-hlr_10.42.42.2(pid=17416): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17416)] 18:34:09.225204 run osmo-hlr_10.42.42.2(pid=17416): stdout: | (launched: 2022-12-13_18:34:06.130339) 18:34:09.278233 run osmo-hlr_10.42.42.2(pid=17416): stderr: | [0;m[1;31m20221213183406327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183406328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183406328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183406328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183406328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183406328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183406340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183406348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183406349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183406349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:09.352148 run osmo-msc_10.42.42.6(pid=17422): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17422)] 18:34:09.402938 run osmo-msc_10.42.42.6(pid=17422): stdout: | (launched: 2022-12-13_18:34:08.176115) 18:34:09.455576 run osmo-msc_10.42.42.6(pid=17422): stderr: | [0;m[38;5;43m20221213183408497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183408497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b0ae55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183408497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183408497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183408498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183408498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183408499 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183408500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183408500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183408500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:09.508521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17415): Terminating (SIGTERM) 18:34:09.550710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17418): Terminating (SIGTERM) 18:34:09.593319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17421): Terminating (SIGTERM) 18:34:09.636209 --- ParallelTerminationStrategy: PID 17415 died... 18:34:09.656889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17415): Terminated: ok {rc=0} 18:34:09.704041 --- ParallelTerminationStrategy: PID 17418 died... 18:34:09.724197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17418): Terminated: ok {rc=0} 18:34:09.771342 --- ParallelTerminationStrategy: PID 17421 died... 18:34:09.791521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17421): Terminated: ok {rc=0} 18:34:09.880790 bus /sierra_3: Setting Powered False 18:34:10.981722 bus /sierra_3: Setting Powered False 18:34:12.102369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 18:34:13.382042 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:13.387732 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:34:13.445735 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:34:13.472451 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:34:13.522779 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:34:13.580717 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:34:13.607140 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:34:14.165549 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 18:34:14.171275 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.182970 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:14.228741 tst handover.py: using LAC 35494 18:34:14.357474 tst handover.py: using RAC 49 18:34:14.487429 tst handover.py: using CellId 35494 18:34:14.613408 tst handover.py: using BVCI 35495 18:34:14.727334 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:14.773620 tst handover.py: using LAC 35495 18:34:14.896553 tst handover.py: using RAC 50 18:34:15.017438 tst handover.py: using CellId 35495 18:34:15.139985 tst handover.py: using BVCI 35496 18:34:15.265548 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:15.277235 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:15.288755 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:15.300394 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:15.312326 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:15.324408 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:15.446049 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:15.571879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:16.065592 run create_hlr_db(pid=17427): Launched 18:34:16.229655 bus /sierra_2: Setting Powered False 18:34:17.306475 run create_hlr_db(pid=17427): Terminated: ok {rc=0} 18:34:17.727841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Launched 18:34:18.040854 run osmo-hlr_10.42.42.2(pid=17430): Launched 18:34:18.159680 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:18.684118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Launched 18:34:18.996881 run osmo-stp_10.42.42.5(pid=17433): Launched 18:34:19.115716 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:19.652064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17435): Launched 18:34:19.963265 run osmo-msc_10.42.42.6(pid=17436): Launched 18:34:20.136917 run osmo-stp_10.42.42.5(pid=17433): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] 18:34:20.268237 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-13_18:34:18.938849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:20.399156 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221213183419108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183419109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183419109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183419109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:20.528376 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-13_18:34:18.938849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:20.652723 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221213183419108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183419109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183419109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183419109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183419110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:20.800410 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 18:34:20.808870 tst handover.py:18: Test FAILED (6.6 sec) 18:34:20.835628 run osmo-hlr_10.42.42.2(pid=17430): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17430)] 18:34:20.884355 run osmo-hlr_10.42.42.2(pid=17430): stdout: | (launched: 2022-12-13_18:34:17.982832) 18:34:20.934620 run osmo-hlr_10.42.42.2(pid=17430): stderr: | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183418159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183418171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183418180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183418180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183418180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:21.004778 run osmo-msc_10.42.42.6(pid=17436): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17436)] 18:34:21.053461 run osmo-msc_10.42.42.6(pid=17436): stdout: | (launched: 2022-12-13_18:34:19.905608) 18:34:21.103440 run osmo-msc_10.42.42.6(pid=17436): stderr: | [0;m[38;5;43m20221213183420176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183420176 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f038436fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183420177 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183420177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183420177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183420177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183420179 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183420179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183420179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183420179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:21.153685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminating (SIGTERM) 18:34:21.193891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminating (SIGTERM) 18:34:21.233888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17435): Terminating (SIGTERM) 18:34:21.274308 --- ParallelTerminationStrategy: PID 17429 died... 18:34:21.293960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminated: ok {rc=0} 18:34:21.338575 --- ParallelTerminationStrategy: PID 17432 died... 18:34:21.357510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminated: ok {rc=0} 18:34:21.401886 --- ParallelTerminationStrategy: PID 17435 died... 18:34:21.420786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17435): Terminated: ok {rc=0} 18:34:21.508097 bus /sierra_3: Setting Powered False 18:34:22.608546 bus /sierra_3: Setting Powered False 18:34:23.726851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 18:34:25.001598 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:25.007300 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:34:25.060733 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:34:25.088175 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:34:25.143584 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:34:25.197101 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:34:25.224906 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:34:25.770171 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 18:34:25.775781 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:25.787026 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 18:34:25.834648 tst handover.py: using LAC 35496 18:34:25.957044 tst handover.py: using RAC 51 18:34:26.079981 tst handover.py: using CellId 35496 18:34:26.204141 tst handover.py: using BVCI 35497 18:34:26.319116 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 18:34:26.359648 tst handover.py: using LAC 35497 18:34:26.490596 tst handover.py: using RAC 52 18:34:26.619080 tst handover.py: using CellId 35497 18:34:26.749971 tst handover.py: using BVCI 35498 18:34:26.873553 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:26.885243 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:26.896644 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:26.907949 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:26.919599 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:34:26.931126 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 18:34:27.051366 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 18:34:27.172089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:27.662905 run create_hlr_db(pid=17441): Launched 18:34:27.790828 bus /sierra_2: Setting Powered False 18:34:28.856198 run create_hlr_db(pid=17441): Terminated: ok {rc=0} 18:34:29.292591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17443): Launched 18:34:29.628399 run osmo-hlr_10.42.42.2(pid=17444): Launched 18:34:29.756512 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:30.307584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17446): Launched 18:34:30.643298 run osmo-stp_10.42.42.5(pid=17447): Launched 18:34:30.770740 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:31.406571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17449): Launched 18:34:31.740820 run osmo-msc_10.42.42.6(pid=17450): Launched 18:34:32.143187 run osmo-stp_10.42.42.5(pid=17447): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17447)] 18:34:32.375505 run osmo-stp_10.42.42.5(pid=17447): stdout: | (launched: 2022-12-13_18:34:30.581676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:32.509139 run osmo-stp_10.42.42.5(pid=17447): stderr: | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183430772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:32.638748 run osmo-stp_10.42.42.5(pid=17447): stdout: | (launched: 2022-12-13_18:34:30.581676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:32.763529 run osmo-stp_10.42.42.5(pid=17447): stderr: | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183430771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183430772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183430772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:32.911707 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17447): Process ended prematurely: osmo-stp_10.42.42.5(pid=17447) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17447)] [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 18:34:32.920270 tst handover.py:18: Test FAILED (7.1 sec) 18:34:32.946831 run osmo-hlr_10.42.42.2(pid=17444): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17444)] 18:34:32.995507 run osmo-hlr_10.42.42.2(pid=17444): stdout: | (launched: 2022-12-13_18:34:29.566868) 18:34:33.045757 run osmo-hlr_10.42.42.2(pid=17444): stderr: | [0;m[1;31m20221213183429762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183429762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183429762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183429762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183429762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183429763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183429775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183429783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183429784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183429784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:33.116108 run osmo-msc_10.42.42.6(pid=17450): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17450)] 18:34:33.164473 run osmo-msc_10.42.42.6(pid=17450): stdout: | (launched: 2022-12-13_18:34:31.682038) 18:34:33.214637 run osmo-msc_10.42.42.6(pid=17450): stderr: | [0;m[38;5;43m20221213183432229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183432229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90931b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183432229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183432229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183432230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183432230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183432231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183432232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183432232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183432232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:33.264761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17443): Terminating (SIGTERM) 18:34:33.305165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17446): Terminating (SIGTERM) 18:34:33.345647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17449): Terminating (SIGTERM) 18:34:33.386499 --- ParallelTerminationStrategy: PID 17443 died... 18:34:33.406266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17443): Terminated: ok {rc=0} 18:34:33.451366 --- ParallelTerminationStrategy: PID 17446 died... 18:34:33.470638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17446): Terminated: ok {rc=0} 18:34:33.515673 --- ParallelTerminationStrategy: PID 17449 died... 18:34:33.535074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17449): Terminated: ok {rc=0} 18:34:33.623257 bus /sierra_3: Setting Powered False 18:34:34.723654 bus /sierra_3: Setting Powered False 18:34:35.841430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 18:34:37.109491 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:37.115199 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:34:37.180897 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:34:37.208277 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:34:37.267555 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:34:37.334226 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:34:37.360670 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:34:37.914028 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 18:34:37.921364 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:37.933293 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:37.987430 tst handover.py: using LAC 35498 18:34:38.118255 tst handover.py: using RAC 53 18:34:38.249388 tst handover.py: using CellId 35498 18:34:38.377358 tst handover.py: using BVCI 35499 18:34:38.498500 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:38.546312 tst handover.py: using LAC 35499 18:34:38.677526 tst handover.py: using RAC 54 18:34:38.808515 tst handover.py: using CellId 35499 18:34:38.937271 tst handover.py: using BVCI 35500 18:34:39.058375 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:39.070070 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:39.081693 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:39.093200 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:39.104881 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:39.116656 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:39.236030 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:39.358057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:39.845835 run create_hlr_db(pid=17455): Launched 18:34:39.975717 bus /sierra_2: Setting Powered False 18:34:41.041419 run create_hlr_db(pid=17455): Terminated: ok {rc=0} 18:34:41.476849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Launched 18:34:41.811180 run osmo-hlr_10.42.42.2(pid=17458): Launched 18:34:41.938954 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:42.489387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Launched 18:34:42.823627 run osmo-stp_10.42.42.5(pid=17461): Launched 18:34:42.950972 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:43.526954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Launched 18:34:43.861054 run osmo-msc_10.42.42.6(pid=17464): Launched 18:34:44.046593 run osmo-stp_10.42.42.5(pid=17461): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] 18:34:44.187313 run osmo-stp_10.42.42.5(pid=17461): stdout: | (launched: 2022-12-13_18:34:42.762525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:44.328162 run osmo-stp_10.42.42.5(pid=17461): stderr: | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183442952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:44.467196 run osmo-stp_10.42.42.5(pid=17461): stdout: | (launched: 2022-12-13_18:34:42.762525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:44.599877 run osmo-stp_10.42.42.5(pid=17461): stderr: | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183442951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183442952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183442952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:44.759101 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17461): Process ended prematurely: osmo-stp_10.42.42.5(pid=17461) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 18:34:44.768238 tst handover.py:18: Test FAILED (6.8 sec) 18:34:44.796497 run osmo-hlr_10.42.42.2(pid=17458): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17458)] 18:34:44.848770 run osmo-hlr_10.42.42.2(pid=17458): stdout: | (launched: 2022-12-13_18:34:41.749734) 18:34:44.902074 run osmo-hlr_10.42.42.2(pid=17458): stderr: | [0;m[1;31m20221213183441944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183441944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183441944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183441945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183441945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183441945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183441957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183441966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183441966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183441966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:44.976073 run osmo-msc_10.42.42.6(pid=17464): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17464)] 18:34:45.027151 run osmo-msc_10.42.42.6(pid=17464): stdout: | (launched: 2022-12-13_18:34:43.799265) 18:34:45.079948 run osmo-msc_10.42.42.6(pid=17464): stderr: | [0;m[38;5;43m20221213183444118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183444119 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbea1098c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183444119 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183444119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183444119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183444119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183444121 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183444121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183444121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183444122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:45.133326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Terminating (SIGTERM) 18:34:45.175859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Terminating (SIGTERM) 18:34:45.218842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Terminating (SIGTERM) 18:34:45.262072 --- ParallelTerminationStrategy: PID 17457 died... 18:34:45.283060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Terminated: ok {rc=0} 18:34:45.330626 --- ParallelTerminationStrategy: PID 17460 died... 18:34:45.351087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Terminated: ok {rc=0} 18:34:45.398088 --- ParallelTerminationStrategy: PID 17463 died... 18:34:45.418494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Terminated: ok {rc=0} 18:34:45.509200 bus /sierra_3: Setting Powered False 18:34:46.607552 bus /sierra_3: Setting Powered False 18:34:47.724450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 18:34:49.004878 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:49.011043 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:34:49.076387 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:34:49.103976 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:34:49.157411 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:34:49.223849 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:34:49.251632 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:34:49.804148 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 18:34:49.810478 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:49.821997 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:49.870649 tst handover.py: using LAC 35500 18:34:49.991974 tst handover.py: using RAC 55 18:34:50.119271 tst handover.py: using CellId 35500 18:34:50.240379 tst handover.py: using BVCI 35501 18:34:50.364054 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:50.411513 tst handover.py: using LAC 35501 18:34:50.540652 tst handover.py: using RAC 56 18:34:50.671640 tst handover.py: using CellId 35501 18:34:50.799925 tst handover.py: using BVCI 35502 18:34:50.921403 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:50.933138 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:50.944599 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:50.955990 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:50.967835 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:50.979498 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:51.097412 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:51.215398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:51.673375 run create_hlr_db(pid=17469): Launched 18:34:51.800659 bus /sierra_2: Setting Powered False 18:34:52.863453 run create_hlr_db(pid=17469): Terminated: ok {rc=0} 18:34:53.290935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17471): Launched 18:34:53.625447 run osmo-hlr_10.42.42.2(pid=17472): Launched 18:34:53.753717 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:54.304402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17474): Launched 18:34:54.637914 run osmo-stp_10.42.42.5(pid=17475): Launched 18:34:54.765415 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:55.338445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17477): Launched 18:34:55.672668 run osmo-msc_10.42.42.6(pid=17478): Launched 18:34:55.858527 run osmo-stp_10.42.42.5(pid=17475): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17475)] 18:34:55.999470 run osmo-stp_10.42.42.5(pid=17475): stdout: | (launched: 2022-12-13_18:34:54.576179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:56.140431 run osmo-stp_10.42.42.5(pid=17475): stderr: | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183454767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:56.279044 run osmo-stp_10.42.42.5(pid=17475): stdout: | (launched: 2022-12-13_18:34:54.576179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:56.411433 run osmo-stp_10.42.42.5(pid=17475): stderr: | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183454767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183454767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183454768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:56.570026 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17475): Process ended prematurely: osmo-stp_10.42.42.5(pid=17475) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17475)] [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 18:34:56.579041 tst handover.py:18: Test FAILED (6.8 sec) 18:34:56.607186 run osmo-hlr_10.42.42.2(pid=17472): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17472)] 18:34:56.659466 run osmo-hlr_10.42.42.2(pid=17472): stdout: | (launched: 2022-12-13_18:34:53.563602) 18:34:56.712592 run osmo-hlr_10.42.42.2(pid=17472): stderr: | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183453760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183453772 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183453781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183453781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183453781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:56.786565 run osmo-msc_10.42.42.6(pid=17478): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17478)] 18:34:56.837218 run osmo-msc_10.42.42.6(pid=17478): stdout: | (launched: 2022-12-13_18:34:55.611165) 18:34:56.890567 run osmo-msc_10.42.42.6(pid=17478): stderr: | [0;m[38;5;43m20221213183455929 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183455930 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb13ee2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183455930 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183455930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183455930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183455930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183455932 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183455932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183455932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183455932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:56.943698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17471): Terminating (SIGTERM) 18:34:56.986709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17474): Terminating (SIGTERM) 18:34:57.029776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17477): Terminating (SIGTERM) 18:34:57.073073 --- ParallelTerminationStrategy: PID 17471 died... 18:34:57.093790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17471): Terminated: ok {rc=0} 18:34:57.141298 --- ParallelTerminationStrategy: PID 17474 died... 18:34:57.161601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17474): Terminated: ok {rc=0} 18:34:57.208742 --- ParallelTerminationStrategy: PID 17477 died... 18:34:57.229402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17477): Terminated: ok {rc=0} 18:34:57.319820 bus /sierra_3: Setting Powered False 18:34:58.419481 bus /sierra_3: Setting Powered False 18:34:59.540160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 18:35:00.820269 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:35:00.826410 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:35:00.903100 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:35:00.931513 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:35:00.990179 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:35:01.050805 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:35:01.079046 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:35:01.646692 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 18:35:01.652909 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:01.665657 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:35:01.705456 tst handover.py: using LAC 35502 18:35:01.853017 tst handover.py: using RAC 57 18:35:02.034458 tst handover.py: using CellId 35502 18:35:02.189109 tst handover.py: using BVCI 35503 18:35:02.365461 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:35:02.420430 tst handover.py: using LAC 35503 18:35:02.575926 tst handover.py: using RAC 58 18:35:02.725318 tst handover.py: using CellId 35503 18:35:02.855147 tst handover.py: using BVCI 35504 18:35:02.976941 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:02.988398 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:02.999692 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:03.010927 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:03.022578 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:35:03.034041 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:35:03.153353 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:35:03.271363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:03.727652 run create_hlr_db(pid=17494): Launched 18:35:03.855910 bus /sierra_2: Setting Powered False 18:35:04.918050 run create_hlr_db(pid=17494): Terminated: ok {rc=0} 18:35:05.327494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Launched 18:35:05.641698 run osmo-hlr_10.42.42.2(pid=17497): Launched 18:35:05.760739 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:06.287058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Launched 18:35:06.599939 run osmo-stp_10.42.42.5(pid=17500): Launched 18:35:06.718325 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:07.255028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17502): Launched 18:35:07.568504 run osmo-msc_10.42.42.6(pid=17503): Launched 18:35:07.743330 run osmo-stp_10.42.42.5(pid=17500): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] 18:35:07.874982 run osmo-stp_10.42.42.5(pid=17500): stdout: | (launched: 2022-12-13_18:35:06.542115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:08.006353 run osmo-stp_10.42.42.5(pid=17500): stderr: | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183506713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183506713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183506713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183506714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:08.135919 run osmo-stp_10.42.42.5(pid=17500): stdout: | (launched: 2022-12-13_18:35:06.542115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:08.259878 run osmo-stp_10.42.42.5(pid=17500): stderr: | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183506712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183506713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183506713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183506713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183506714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:08.408249 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17500): Process ended prematurely: osmo-stp_10.42.42.5(pid=17500) [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 18:35:08.416552 tst handover.py:18: Test FAILED (6.8 sec) 18:35:08.443448 run osmo-hlr_10.42.42.2(pid=17497): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17497)] 18:35:08.492896 run osmo-hlr_10.42.42.2(pid=17497): stdout: | (launched: 2022-12-13_18:35:05.583431) 18:35:08.542927 run osmo-hlr_10.42.42.2(pid=17497): stderr: | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183505759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183505771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183505780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183505780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183505780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:08.613006 run osmo-msc_10.42.42.6(pid=17503): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17503)] 18:35:08.661452 run osmo-msc_10.42.42.6(pid=17503): stdout: | (launched: 2022-12-13_18:35:07.510108) 18:35:08.711443 run osmo-msc_10.42.42.6(pid=17503): stderr: | [0;m[38;5;43m20221213183507791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183507791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b35bbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183507791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183507791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183507791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183507792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183507793 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183507794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183507794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183507794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:08.761665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Terminating (SIGTERM) 18:35:08.802368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Terminating (SIGTERM) 18:35:08.843689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17502): Terminating (SIGTERM) 18:35:08.884597 --- ParallelTerminationStrategy: PID 17496 died... 18:35:08.904352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Terminated: ok {rc=0} 18:35:08.949956 --- ParallelTerminationStrategy: PID 17499 died... 18:35:08.969225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Terminated: ok {rc=0} 18:35:09.014100 --- ParallelTerminationStrategy: PID 17502 died... 18:35:09.033172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17502): Terminated: ok {rc=0} 18:35:09.118367 bus /sierra_3: Setting Powered False 18:35:10.218630 bus /sierra_3: Setting Powered False 18:35:11.336452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 18:35:12.594061 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:35:12.599760 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:35:12.654821 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:35:12.683515 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:35:12.747197 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:35:12.798380 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:35:12.827348 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:35:13.377742 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 18:35:13.384590 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:13.396403 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:35:13.432313 tst handover.py: using LAC 35504 18:35:13.557590 tst handover.py: using RAC 59 18:35:13.692386 tst handover.py: using CellId 35504 18:35:13.820256 tst handover.py: using BVCI 35505 18:35:13.945088 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:35:13.994299 tst handover.py: using LAC 35505 18:35:14.135026 tst handover.py: using RAC 60 18:35:14.270756 tst handover.py: using CellId 35505 18:35:14.402375 tst handover.py: using BVCI 35506 18:35:14.528058 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:14.540389 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:14.552609 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:14.564758 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:14.578159 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:14.591325 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:35:14.721700 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:35:14.852163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:15.309153 run create_hlr_db(pid=17859): Launched 18:35:15.436257 bus /sierra_2: Setting Powered False 18:35:16.497960 run create_hlr_db(pid=17859): Terminated: ok {rc=0} 18:35:16.965931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Launched 18:35:17.312439 run osmo-hlr_10.42.42.2(pid=17862): Launched 18:35:17.441199 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:17.992299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Launched 18:35:18.326677 run osmo-stp_10.42.42.5(pid=17865): Launched 18:35:18.453431 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:19.028275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17867): Launched 18:35:19.363687 run osmo-msc_10.42.42.6(pid=17868): Launched 18:35:19.550673 run osmo-stp_10.42.42.5(pid=17865): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] 18:35:19.726718 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-13_18:35:18.265271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:19.868331 run osmo-stp_10.42.42.5(pid=17865): stderr: | [0;m[38;5;43m20221213183518456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183518456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183518457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183518457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:20.007584 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-13_18:35:18.265271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:20.140702 run osmo-stp_10.42.42.5(pid=17865): stderr: | [0;m[38;5;43m20221213183518456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183518456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183518457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183518457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183518458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:20.299905 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 18:35:20.309069 tst handover.py:18: Test FAILED (6.9 sec) 18:35:20.337412 run osmo-hlr_10.42.42.2(pid=17862): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17862)] 18:35:20.390012 run osmo-hlr_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-13_18:35:17.251027) 18:35:20.443435 run osmo-hlr_10.42.42.2(pid=17862): stderr: | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183517446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183517458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183517467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183517467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183517467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:20.517596 run osmo-msc_10.42.42.6(pid=17868): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17868)] 18:35:20.569247 run osmo-msc_10.42.42.6(pid=17868): stdout: | (launched: 2022-12-13_18:35:19.301888) 18:35:20.622651 run osmo-msc_10.42.42.6(pid=17868): stderr: | [0;m[38;5;43m20221213183519624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183519624 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd26dac1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183519624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183519624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183519624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183519625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183519626 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183519627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183519627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183519627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:20.676364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminating (SIGTERM) 18:35:20.719098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminating (SIGTERM) 18:35:20.762353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17867): Terminating (SIGTERM) 18:35:20.805672 --- ParallelTerminationStrategy: PID 17861 died... 18:35:20.826520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminated: ok {rc=0} 18:35:20.874278 --- ParallelTerminationStrategy: PID 17864 died... 18:35:20.894609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminated: ok {rc=0} 18:35:20.942246 --- ParallelTerminationStrategy: PID 17867 died... 18:35:20.962559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17867): Terminated: ok {rc=0} 18:35:21.054060 bus /sierra_3: Setting Powered False 18:35:22.154784 bus /sierra_3: Setting Powered False 18:35:23.287677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2392 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 18:35:24.563033 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:35:24.568932 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:35:24.633395 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:35:24.660863 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:35:24.715435 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:35:24.779815 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:35:24.807257 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:35:25.353960 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2392 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 18:35:25.360883 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:25.372848 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:35:25.421775 tst handover.py: using LAC 35506 18:35:25.542870 tst handover.py: using RAC 61 18:35:25.669799 tst handover.py: using CellId 35506 18:35:25.792195 tst handover.py: using BVCI 35507 18:35:25.909969 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:35:25.957403 tst handover.py: using LAC 35507 18:35:26.084297 tst handover.py: using RAC 62 18:35:26.206004 tst handover.py: using CellId 35507 18:35:26.328904 tst handover.py: using BVCI 35508 18:35:26.445887 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:26.458381 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:26.470044 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:26.481945 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:26.494703 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:35:26.507233 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:35:26.633720 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:35:26.757340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:27.229622 run create_hlr_db(pid=18048): Launched 18:35:27.391605 bus /sierra_2: Setting Powered False 18:35:28.456078 run create_hlr_db(pid=18048): Terminated: ok {rc=0} 18:35:28.883423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Launched 18:35:29.239801 run osmo-hlr_10.42.42.2(pid=18052): Launched 18:35:29.368421 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:29.919207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Launched 18:35:30.253730 run osmo-stp_10.42.42.5(pid=18055): Launched 18:35:30.380599 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:30.961763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18057): Launched 18:35:31.313816 run osmo-msc_10.42.42.6(pid=18058): Launched 18:35:31.610725 run osmo-stp_10.42.42.5(pid=18055): ERR: Terminated: ERROR {rc=1} [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] 18:35:31.890758 run osmo-stp_10.42.42.5(pid=18055): stdout: | (launched: 2022-12-13_18:35:30.192368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:32.220466 run osmo-stp_10.42.42.5(pid=18055): stderr: | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183530385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:32.373889 run osmo-stp_10.42.42.5(pid=18055): stdout: | (launched: 2022-12-13_18:35:30.192368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:32.504172 run osmo-stp_10.42.42.5(pid=18055): stderr: | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213183530384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213183530385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213183530385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:32.652707 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18055): Process ended prematurely: osmo-stp_10.42.42.5(pid=18055) [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 18:35:32.661235 tst handover.py:18: Test FAILED (7.3 sec) 18:35:32.688598 run osmo-hlr_10.42.42.2(pid=18052): ERR: Terminated: ERROR {rc=237} [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18052)] 18:35:32.738113 run osmo-hlr_10.42.42.2(pid=18052): stdout: | (launched: 2022-12-13_18:35:29.178348) 18:35:32.788931 run osmo-hlr_10.42.42.2(pid=18052): stderr: | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213183529375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213183529387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213183529397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213183529397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213183529397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:32.859581 run osmo-msc_10.42.42.6(pid=18058): ERR: Terminated: ERROR {rc=2} [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18058)] 18:35:32.908298 run osmo-msc_10.42.42.6(pid=18058): stdout: | (launched: 2022-12-13_18:35:31.247617) 18:35:32.958895 run osmo-msc_10.42.42.6(pid=18058): stderr: | [0;m[38;5;43m20221213183531842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213183531843 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdf12a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213183531843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213183531843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213183531843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213183531843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213183531845 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213183531847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213183531848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213183531848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:33.009911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Terminating (SIGTERM) 18:35:33.050461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Terminating (SIGTERM) 18:35:33.091037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18057): Terminating (SIGTERM) 18:35:33.132455 --- ParallelTerminationStrategy: PID 18051 died... 18:35:33.152503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Terminated: ok {rc=0} 18:35:33.197921 --- ParallelTerminationStrategy: PID 18054 died... 18:35:33.217184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Terminated: ok {rc=0} 18:35:33.262274 --- ParallelTerminationStrategy: PID 18057 died... 18:35:33.281474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18057): Terminated: ok {rc=0} 18:35:33.370560 bus /sierra_3: Setting Powered False 18:35:34.472941 bus /sierra_3: Setting Powered False 18:35:35.592755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2392 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 18:35:36.861681 tst trial-2392: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392/run.2022-12-13_17-10-08/trial-2392.xml -------------------------------------------------------------------------------------------- trial-2392 FAIL -------------------------------------------------------------------------------------------- 18:35:38.804016 tst trial-2392: trial-2392: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=9311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9311) [trial-2392↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9311)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=9321): Process ended prematurely: osmo-stp_10.42.42.5(pid=9321) [trial-2392↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9321)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9330): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9330) [trial-2392↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9330)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9340): Process ended prematurely: osmo-stp_10.42.42.5(pid=9340) [trial-2392↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9340)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9354): Process ended prematurely: osmo-stp_10.42.42.5(pid=9354) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9354)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9365): Process ended prematurely: osmo-stp_10.42.42.5(pid=9365) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9365)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9380): Process ended prematurely: osmo-stp_10.42.42.5(pid=9380) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9380)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9406): Process ended prematurely: osmo-stp_10.42.42.5(pid=9406) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2392↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9442): Process ended prematurely: osmo-stp_10.42.42.5(pid=9442) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9456): Process ended prematurely: osmo-stp_10.42.42.5(pid=9456) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9456)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9467): Process ended prematurely: osmo-stp_10.42.42.5(pid=9467) [trial-2392↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9467)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9481): Process ended prematurely: osmo-stp_10.42.42.5(pid=9481) [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9481)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9495): Process ended prematurely: osmo-stp_10.42.42.5(pid=9495) [trial-2392↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9495)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9509): Process ended prematurely: osmo-stp_10.42.42.5(pid=9509) [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2392↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9534): Process ended prematurely: osmo-stp_10.42.42.5(pid=9534) [trial-2392↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9534)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9545): Process ended prematurely: osmo-stp_10.42.42.5(pid=9545) [trial-2392↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=9565): Process ended prematurely: osmo-stp_10.42.42.5(pid=9565) [trial-2392↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2392↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9595): Process ended prematurely: osmo-stp_10.42.42.5(pid=9595) [trial-2392↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9605): Process ended prematurely: osmo-stp_10.42.42.5(pid=9605) [trial-2392↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9605)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9615): Process ended prematurely: osmo-stp_10.42.42.5(pid=9615) [trial-2392↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9615)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9635): Process ended prematurely: osmo-stp_10.42.42.5(pid=9635) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9635)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=9673): Process ended prematurely: osmo-stp_10.42.42.5(pid=9673) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9673)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=9683): Process ended prematurely: osmo-stp_10.42.42.5(pid=9683) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2392↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9722): Process ended prematurely: osmo-stp_10.42.42.5(pid=9722) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9722)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=9740): Process ended prematurely: osmo-stp_10.42.42.5(pid=9740) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9740)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2392↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=9790): Process ended prematurely: osmo-stp_10.42.42.5(pid=9790) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=9808): Process ended prematurely: osmo-stp_10.42.42.5(pid=9808) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9808)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9828): Process ended prematurely: osmo-stp_10.42.42.5(pid=9828) [trial-2392↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9844): Process ended prematurely: osmo-stp_10.42.42.5(pid=9844) [trial-2392↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9857): Process ended prematurely: osmo-stp_10.42.42.5(pid=9857) [trial-2392↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9868): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9868) [trial-2392↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9868)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9879): Process ended prematurely: osmo-stp_10.42.42.5(pid=9879) [trial-2392↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9879)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9888): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9888) [trial-2392↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9888)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9901): Process ended prematurely: osmo-stp_10.42.42.5(pid=9901) [trial-2392↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9901)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9916): Process ended prematurely: osmo-stp_10.42.42.5(pid=9916) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9916)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9927): Process ended prematurely: osmo-stp_10.42.42.5(pid=9927) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9941): Process ended prematurely: osmo-stp_10.42.42.5(pid=9941) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9941)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9966): Process ended prematurely: osmo-stp_10.42.42.5(pid=9966) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9977): Process ended prematurely: osmo-stp_10.42.42.5(pid=9977) [trial-2392↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9977)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9991): Process ended prematurely: osmo-stp_10.42.42.5(pid=9991) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9991)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10002): Process ended prematurely: osmo-stp_10.42.42.5(pid=10002) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10002)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10016): Process ended prematurely: osmo-stp_10.42.42.5(pid=10016) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10016)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10028): Process ended prematurely: osmo-stp_10.42.42.5(pid=10028) [trial-2392↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10028)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10043): Process ended prematurely: osmo-stp_10.42.42.5(pid=10043) [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10043)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10054): Process ended prematurely: osmo-stp_10.42.42.5(pid=10054) [trial-2392↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10054)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10068): Process ended prematurely: osmo-stp_10.42.42.5(pid=10068) [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10068)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10079): Process ended prematurely: osmo-stp_10.42.42.5(pid=10079) [trial-2392↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10079)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10093): Process ended prematurely: osmo-stp_10.42.42.5(pid=10093) [trial-2392↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10093)] FAIL: emergency_preemptive_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10115): Process ended prematurely: osmo-stp_10.42.42.5(pid=10115) [trial-2392↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=10393): Process ended prematurely: osmo-stp_10.42.42.5(pid=10393) [trial-2392↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=10405): Process ended prematurely: osmo-stp_10.42.42.5(pid=10405) [trial-2392↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10405)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10423): Process ended prematurely: osmo-stp_10.42.42.5(pid=10423) [trial-2392↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10423)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=10433): Process ended prematurely: osmo-stp_10.42.42.5(pid=10433) [trial-2392↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10444): Process ended prematurely: osmo-stp_10.42.42.5(pid=10444) [trial-2392↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10444)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10465): Process ended prematurely: osmo-stp_10.42.42.5(pid=10465) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10465)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10477): Process ended prematurely: osmo-stp_10.42.42.5(pid=10477) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10495): Process ended prematurely: osmo-stp_10.42.42.5(pid=10495) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10495)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10505): Process ended prematurely: osmo-stp_10.42.42.5(pid=10505) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10519): Process ended prematurely: osmo-stp_10.42.42.5(pid=10519) [trial-2392↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10519)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10568): Process ended prematurely: osmo-stp_10.42.42.5(pid=10568) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10568)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10578): Process ended prematurely: osmo-stp_10.42.42.5(pid=10578) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10578)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10588): Process ended prematurely: osmo-stp_10.42.42.5(pid=10588) [trial-2392↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10588)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10606): Process ended prematurely: osmo-stp_10.42.42.5(pid=10606) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10618): Process ended prematurely: osmo-stp_10.42.42.5(pid=10618) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10618)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10636): Process ended prematurely: osmo-stp_10.42.42.5(pid=10636) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10646): Process ended prematurely: osmo-stp_10.42.42.5(pid=10646) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10646)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10656): Process ended prematurely: osmo-stp_10.42.42.5(pid=10656) [trial-2392↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10656)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10669): Process ended prematurely: osmo-stp_10.42.42.5(pid=10669) [trial-2392↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10669)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10682): Process ended prematurely: osmo-stp_10.42.42.5(pid=10682) [trial-2392↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10682)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10691) [trial-2392↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10691)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10702): Process ended prematurely: osmo-stp_10.42.42.5(pid=10702) [trial-2392↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10711): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10711) [trial-2392↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10711)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10721): Process ended prematurely: osmo-stp_10.42.42.5(pid=10721) [trial-2392↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10721)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10746): Process ended prematurely: osmo-stp_10.42.42.5(pid=10746) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10760): Process ended prematurely: osmo-stp_10.42.42.5(pid=10760) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10786): Process ended prematurely: osmo-stp_10.42.42.5(pid=10786) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10786)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10797): Process ended prematurely: osmo-stp_10.42.42.5(pid=10797) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10797)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10814): Process ended prematurely: osmo-stp_10.42.42.5(pid=10814) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10825): Process ended prematurely: osmo-stp_10.42.42.5(pid=10825) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10839): Process ended prematurely: osmo-stp_10.42.42.5(pid=10839) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10850): Process ended prematurely: osmo-stp_10.42.42.5(pid=10850) [trial-2392↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10875): Process ended prematurely: osmo-stp_10.42.42.5(pid=10875) [trial-2392↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10875)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10889): Process ended prematurely: osmo-stp_10.42.42.5(pid=10889) [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10901): Process ended prematurely: osmo-stp_10.42.42.5(pid=10901) [trial-2392↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10901)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10928): Process ended prematurely: osmo-stp_10.42.42.5(pid=10928) [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10928)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10939): Process ended prematurely: osmo-stp_10.42.42.5(pid=10939) [trial-2392↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10939)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10953): Process ended prematurely: osmo-stp_10.42.42.5(pid=10953) [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10953)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10964): Process ended prematurely: osmo-stp_10.42.42.5(pid=10964) [trial-2392↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10964)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10979): Process ended prematurely: osmo-stp_10.42.42.5(pid=10979) [trial-2392↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10990): Process ended prematurely: osmo-stp_10.42.42.5(pid=10990) [trial-2392↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10990)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=11009): Process ended prematurely: osmo-stp_10.42.42.5(pid=11009) [trial-2392↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11022): Process ended prematurely: osmo-stp_10.42.42.5(pid=11022) [trial-2392↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11022)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=11041): Process ended prematurely: osmo-stp_10.42.42.5(pid=11041) [trial-2392↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11051): Process ended prematurely: osmo-stp_10.42.42.5(pid=11051) [trial-2392↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11051)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11061): Process ended prematurely: osmo-stp_10.42.42.5(pid=11061) [trial-2392↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=11091): Process ended prematurely: osmo-stp_10.42.42.5(pid=11091) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11091)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=11109): Process ended prematurely: osmo-stp_10.42.42.5(pid=11109) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11129): Process ended prematurely: osmo-stp_10.42.42.5(pid=11129) [trial-2392↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11129)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=11162): Process ended prematurely: osmo-stp_10.42.42.5(pid=11162) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11162)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=11180): Process ended prematurely: osmo-stp_10.42.42.5(pid=11180) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=11190): Process ended prematurely: osmo-stp_10.42.42.5(pid=11190) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11190)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11200): Process ended prematurely: osmo-stp_10.42.42.5(pid=11200) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11200)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11220): Process ended prematurely: osmo-stp_10.42.42.5(pid=11220) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11220)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11271): Process ended prematurely: osmo-stp_10.42.42.5(pid=11271) [trial-2392↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11288): Process ended prematurely: osmo-stp_10.42.42.5(pid=11288) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11288)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11300): Process ended prematurely: osmo-stp_10.42.42.5(pid=11300) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=11318): Process ended prematurely: osmo-stp_10.42.42.5(pid=11318) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11318)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11329): Process ended prematurely: osmo-stp_10.42.42.5(pid=11329) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11339): Process ended prematurely: osmo-stp_10.42.42.5(pid=11339) [trial-2392↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11339)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11353): Process ended prematurely: osmo-stp_10.42.42.5(pid=11353) [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11353)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11367): Process ended prematurely: osmo-stp_10.42.42.5(pid=11367) [trial-2392↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11367)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11375) [trial-2392↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11375)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11386): Process ended prematurely: osmo-stp_10.42.42.5(pid=11386) [trial-2392↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=11395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11395) [trial-2392↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11395)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11405): Process ended prematurely: osmo-stp_10.42.42.5(pid=11405) [trial-2392↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11405)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=11430): Process ended prematurely: osmo-stp_10.42.42.5(pid=11430) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11717): Process ended prematurely: osmo-stp_10.42.42.5(pid=11717) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11717)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11728): Process ended prematurely: osmo-stp_10.42.42.5(pid=11728) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11742): Process ended prematurely: osmo-stp_10.42.42.5(pid=11742) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11742)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11753): Process ended prematurely: osmo-stp_10.42.42.5(pid=11753) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11767): Process ended prematurely: osmo-stp_10.42.42.5(pid=11767) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11767)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11788): Process ended prematurely: osmo-stp_10.42.42.5(pid=11788) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11788)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12157): Process ended prematurely: osmo-stp_10.42.42.5(pid=12157) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12157)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12343): Process ended prematurely: osmo-stp_10.42.42.5(pid=12343) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12343)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12358): Process ended prematurely: osmo-stp_10.42.42.5(pid=12358) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12358)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12369): Process ended prematurely: osmo-stp_10.42.42.5(pid=12369) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12369)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12383): Process ended prematurely: osmo-stp_10.42.42.5(pid=12383) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12383)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12394): Process ended prematurely: osmo-stp_10.42.42.5(pid=12394) [trial-2392↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2392↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12419): Process ended prematurely: osmo-stp_10.42.42.5(pid=12419) [trial-2392↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12419)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12438): Process ended prematurely: osmo-stp_10.42.42.5(pid=12438) [trial-2392↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12453): Process ended prematurely: osmo-stp_10.42.42.5(pid=12453) [trial-2392↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2392↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12481): Process ended prematurely: osmo-stp_10.42.42.5(pid=12481) [trial-2392↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12481)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12491): Process ended prematurely: osmo-stp_10.42.42.5(pid=12491) [trial-2392↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12508): Process ended prematurely: osmo-stp_10.42.42.5(pid=12508) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12520): Process ended prematurely: osmo-stp_10.42.42.5(pid=12520) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12548): Process ended prematurely: osmo-stp_10.42.42.5(pid=12548) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=12576): Process ended prematurely: osmo-stp_10.42.42.5(pid=12576) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12576)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12588): Process ended prematurely: osmo-stp_10.42.42.5(pid=12588) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12588)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12606): Process ended prematurely: osmo-stp_10.42.42.5(pid=12606) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12606)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12626): Process ended prematurely: osmo-stp_10.42.42.5(pid=12626) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12659): Process ended prematurely: osmo-stp_10.42.42.5(pid=12659) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12659)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=12677): Process ended prematurely: osmo-stp_10.42.42.5(pid=12677) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12677)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12698): Process ended prematurely: osmo-stp_10.42.42.5(pid=12698) [trial-2392↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12713): Process ended prematurely: osmo-stp_10.42.42.5(pid=12713) [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12713)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12728): Process ended prematurely: osmo-stp_10.42.42.5(pid=12728) [trial-2392↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12728)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12736) [trial-2392↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12736)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12746): Process ended prematurely: osmo-stp_10.42.42.5(pid=12746) [trial-2392↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12746)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12755): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12755) [trial-2392↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12755)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12765): Process ended prematurely: osmo-stp_10.42.42.5(pid=12765) [trial-2392↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12765)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12779): Process ended prematurely: osmo-stp_10.42.42.5(pid=12779) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12779)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12790): Process ended prematurely: osmo-stp_10.42.42.5(pid=12790) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12790)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12805): Process ended prematurely: osmo-stp_10.42.42.5(pid=12805) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12805)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12816): Process ended prematurely: osmo-stp_10.42.42.5(pid=12816) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12816)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12830): Process ended prematurely: osmo-stp_10.42.42.5(pid=12830) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12830)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12842): Process ended prematurely: osmo-stp_10.42.42.5(pid=12842) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12842)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12856): Process ended prematurely: osmo-stp_10.42.42.5(pid=12856) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12856)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12867): Process ended prematurely: osmo-stp_10.42.42.5(pid=12867) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12867)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12881): Process ended prematurely: osmo-stp_10.42.42.5(pid=12881) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12892): Process ended prematurely: osmo-stp_10.42.42.5(pid=12892) [trial-2392↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12892)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12906): Process ended prematurely: osmo-stp_10.42.42.5(pid=12906) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12906)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12917): Process ended prematurely: osmo-stp_10.42.42.5(pid=12917) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12933): Process ended prematurely: osmo-stp_10.42.42.5(pid=12933) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12944): Process ended prematurely: osmo-stp_10.42.42.5(pid=12944) [trial-2392↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12944)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12958): Process ended prematurely: osmo-stp_10.42.42.5(pid=12958) [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12969): Process ended prematurely: osmo-stp_10.42.42.5(pid=12969) [trial-2392↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12983): Process ended prematurely: osmo-stp_10.42.42.5(pid=12983) [trial-2392↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12994): Process ended prematurely: osmo-stp_10.42.42.5(pid=12994) [trial-2392↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13016): Process ended prematurely: osmo-stp_10.42.42.5(pid=13016) [trial-2392↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13016)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13028): Process ended prematurely: osmo-stp_10.42.42.5(pid=13028) [trial-2392↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=13046): Process ended prematurely: osmo-stp_10.42.42.5(pid=13046) [trial-2392↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2392↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13069): Process ended prematurely: osmo-stp_10.42.42.5(pid=13069) [trial-2392↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13069)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13086): Process ended prematurely: osmo-stp_10.42.42.5(pid=13086) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13098): Process ended prematurely: osmo-stp_10.42.42.5(pid=13098) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=13116): Process ended prematurely: osmo-stp_10.42.42.5(pid=13116) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13126): Process ended prematurely: osmo-stp_10.42.42.5(pid=13126) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13136): Process ended prematurely: osmo-stp_10.42.42.5(pid=13136) [trial-2392↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13136)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=13155): Process ended prematurely: osmo-stp_10.42.42.5(pid=13155) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13155)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13167): Process ended prematurely: osmo-stp_10.42.42.5(pid=13167) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13167)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=13185): Process ended prematurely: osmo-stp_10.42.42.5(pid=13185) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13185)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13195): Process ended prematurely: osmo-stp_10.42.42.5(pid=13195) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13195)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13205): Process ended prematurely: osmo-stp_10.42.42.5(pid=13205) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13234): Process ended prematurely: osmo-stp_10.42.42.5(pid=13234) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13234)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13252): Process ended prematurely: osmo-stp_10.42.42.5(pid=13252) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13252)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13319): Process ended prematurely: osmo-stp_10.42.42.5(pid=13319) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13319)] FAIL: ping_idle_ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13545): Process ended prematurely: osmo-stp_10.42.42.5(pid=13545) [trial-2392↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13545)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13563): Process ended prematurely: osmo-stp_10.42.42.5(pid=13563) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13563)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13575): Process ended prematurely: osmo-stp_10.42.42.5(pid=13575) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13603): Process ended prematurely: osmo-stp_10.42.42.5(pid=13603) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13617): Process ended prematurely: osmo-stp_10.42.42.5(pid=13617) [trial-2392↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13617)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13630): Process ended prematurely: osmo-stp_10.42.42.5(pid=13630) [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13644): Process ended prematurely: osmo-stp_10.42.42.5(pid=13644) [trial-2392↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13644)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.6 sec) Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2392↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13662): Process ended prematurely: osmo-stp_10.42.42.5(pid=13662) [trial-2392↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13674): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13674) [trial-2392↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13674)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13686): Process ended prematurely: osmo-stp_10.42.42.5(pid=13686) [trial-2392↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13686)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13700): Process ended prematurely: osmo-stp_10.42.42.5(pid=13700) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13700)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13711): Process ended prematurely: osmo-stp_10.42.42.5(pid=13711) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13711)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13725): Process ended prematurely: osmo-stp_10.42.42.5(pid=13725) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13725)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13736): Process ended prematurely: osmo-stp_10.42.42.5(pid=13736) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13736)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13750): Process ended prematurely: osmo-stp_10.42.42.5(pid=13750) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13750)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13761): Process ended prematurely: osmo-stp_10.42.42.5(pid=13761) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13775): Process ended prematurely: osmo-stp_10.42.42.5(pid=13775) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13775)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13801): Process ended prematurely: osmo-stp_10.42.42.5(pid=13801) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13812): Process ended prematurely: osmo-stp_10.42.42.5(pid=13812) [trial-2392↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13812)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13828): Process ended prematurely: osmo-stp_10.42.42.5(pid=13828) [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13828)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13839): Process ended prematurely: osmo-stp_10.42.42.5(pid=13839) [trial-2392↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13853): Process ended prematurely: osmo-stp_10.42.42.5(pid=13853) [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13864): Process ended prematurely: osmo-stp_10.42.42.5(pid=13864) [trial-2392↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13878): Process ended prematurely: osmo-stp_10.42.42.5(pid=13878) [trial-2392↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13889): Process ended prematurely: osmo-stp_10.42.42.5(pid=13889) [trial-2392↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13889)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13908): Process ended prematurely: osmo-stp_10.42.42.5(pid=13908) [trial-2392↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2392↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13938): Process ended prematurely: osmo-stp_10.42.42.5(pid=13938) [trial-2392↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13953): Process ended prematurely: osmo-stp_10.42.42.5(pid=13953) [trial-2392↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13953)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13963): Process ended prematurely: osmo-stp_10.42.42.5(pid=13963) [trial-2392↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13963)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14005): Process ended prematurely: osmo-stp_10.42.42.5(pid=14005) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14018): Process ended prematurely: osmo-stp_10.42.42.5(pid=14018) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14018)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14036): Process ended prematurely: osmo-stp_10.42.42.5(pid=14036) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14036)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14047): Process ended prematurely: osmo-stp_10.42.42.5(pid=14047) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14047)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14058): Process ended prematurely: osmo-stp_10.42.42.5(pid=14058) [trial-2392↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=14075): Process ended prematurely: osmo-stp_10.42.42.5(pid=14075) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14087): Process ended prematurely: osmo-stp_10.42.42.5(pid=14087) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14087)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14105): Process ended prematurely: osmo-stp_10.42.42.5(pid=14105) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14115): Process ended prematurely: osmo-stp_10.42.42.5(pid=14115) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14115)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14125): Process ended prematurely: osmo-stp_10.42.42.5(pid=14125) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14142): Process ended prematurely: osmo-stp_10.42.42.5(pid=14142) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14142)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14154): Process ended prematurely: osmo-stp_10.42.42.5(pid=14154) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14154)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14183): Process ended prematurely: osmo-stp_10.42.42.5(pid=14183) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14183)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2392↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14208): Process ended prematurely: osmo-stp_10.42.42.5(pid=14208) [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14208)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14221): Process ended prematurely: osmo-stp_10.42.42.5(pid=14221) [trial-2392↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14229): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14229) [trial-2392↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14229)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14239): Process ended prematurely: osmo-stp_10.42.42.5(pid=14239) [trial-2392↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2392↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14259): Process ended prematurely: osmo-stp_10.42.42.5(pid=14259) [trial-2392↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14273): Process ended prematurely: osmo-stp_10.42.42.5(pid=14273) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14273)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14309): Process ended prematurely: osmo-stp_10.42.42.5(pid=14309) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14323): Process ended prematurely: osmo-stp_10.42.42.5(pid=14323) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14334): Process ended prematurely: osmo-stp_10.42.42.5(pid=14334) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14351): Process ended prematurely: osmo-stp_10.42.42.5(pid=14351) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14351)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14364): Process ended prematurely: osmo-stp_10.42.42.5(pid=14364) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14378): Process ended prematurely: osmo-stp_10.42.42.5(pid=14378) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14389): Process ended prematurely: osmo-stp_10.42.42.5(pid=14389) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14405): Process ended prematurely: osmo-stp_10.42.42.5(pid=14405) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14405)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14416): Process ended prematurely: osmo-stp_10.42.42.5(pid=14416) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14416)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14430): Process ended prematurely: osmo-stp_10.42.42.5(pid=14430) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14430)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14441): Process ended prematurely: osmo-stp_10.42.42.5(pid=14441) [trial-2392↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14455): Process ended prematurely: osmo-stp_10.42.42.5(pid=14455) [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14455)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14466): Process ended prematurely: osmo-stp_10.42.42.5(pid=14466) [trial-2392↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14466)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14485): Process ended prematurely: osmo-stp_10.42.42.5(pid=14485) [trial-2392↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14485)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=14497): Process ended prematurely: osmo-stp_10.42.42.5(pid=14497) [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14497)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14515): Process ended prematurely: osmo-stp_10.42.42.5(pid=14515) [trial-2392↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14515)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2392↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14536): Process ended prematurely: osmo-stp_10.42.42.5(pid=14536) [trial-2392↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14536)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14553): Process ended prematurely: osmo-stp_10.42.42.5(pid=14553) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=14565): Process ended prematurely: osmo-stp_10.42.42.5(pid=14565) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14565)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14583): Process ended prematurely: osmo-stp_10.42.42.5(pid=14583) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14583)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=14593): Process ended prematurely: osmo-stp_10.42.42.5(pid=14593) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14875): Process ended prematurely: osmo-stp_10.42.42.5(pid=14875) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=14892): Process ended prematurely: osmo-stp_10.42.42.5(pid=14892) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14892)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14905): Process ended prematurely: osmo-stp_10.42.42.5(pid=14905) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14905)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14923): Process ended prematurely: osmo-stp_10.42.42.5(pid=14923) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14923)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14934): Process ended prematurely: osmo-stp_10.42.42.5(pid=14934) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14964): Process ended prematurely: osmo-stp_10.42.42.5(pid=14964) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14964)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14977): Process ended prematurely: osmo-stp_10.42.42.5(pid=14977) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14977)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=14995): Process ended prematurely: osmo-stp_10.42.42.5(pid=14995) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14995)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15005): Process ended prematurely: osmo-stp_10.42.42.5(pid=15005) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15018): Process ended prematurely: osmo-stp_10.42.42.5(pid=15018) [trial-2392↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15031): Process ended prematurely: osmo-stp_10.42.42.5(pid=15031) [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15031)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15045): Process ended prematurely: osmo-stp_10.42.42.5(pid=15045) [trial-2392↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15053): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15053) [trial-2392↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15053)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15063): Process ended prematurely: osmo-stp_10.42.42.5(pid=15063) [trial-2392↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15063)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15072) [trial-2392↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15072)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=15082): Process ended prematurely: osmo-stp_10.42.42.5(pid=15082) [trial-2392↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15096): Process ended prematurely: osmo-stp_10.42.42.5(pid=15096) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15107): Process ended prematurely: osmo-stp_10.42.42.5(pid=15107) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15107)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15121): Process ended prematurely: osmo-stp_10.42.42.5(pid=15121) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15121)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15132): Process ended prematurely: osmo-stp_10.42.42.5(pid=15132) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15132)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15146): Process ended prematurely: osmo-stp_10.42.42.5(pid=15146) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15146)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15157): Process ended prematurely: osmo-stp_10.42.42.5(pid=15157) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15157)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15171): Process ended prematurely: osmo-stp_10.42.42.5(pid=15171) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15171)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15182): Process ended prematurely: osmo-stp_10.42.42.5(pid=15182) [trial-2392↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15182)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15196): Process ended prematurely: osmo-stp_10.42.42.5(pid=15196) [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15196)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15207): Process ended prematurely: osmo-stp_10.42.42.5(pid=15207) [trial-2392↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15207)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15221): Process ended prematurely: osmo-stp_10.42.42.5(pid=15221) [trial-2392↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15232): Process ended prematurely: osmo-stp_10.42.42.5(pid=15232) [trial-2392↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15232)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15250): Process ended prematurely: osmo-stp_10.42.42.5(pid=15250) [trial-2392↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15250)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15263): Process ended prematurely: osmo-stp_10.42.42.5(pid=15263) [trial-2392↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15263)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15281): Process ended prematurely: osmo-stp_10.42.42.5(pid=15281) [trial-2392↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15281)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15291): Process ended prematurely: osmo-stp_10.42.42.5(pid=15291) [trial-2392↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15291)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15311): Process ended prematurely: osmo-stp_10.42.42.5(pid=15311) [trial-2392↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15311)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15680): Process ended prematurely: osmo-stp_10.42.42.5(pid=15680) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=15868): Process ended prematurely: osmo-stp_10.42.42.5(pid=15868) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15868)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15886): Process ended prematurely: osmo-stp_10.42.42.5(pid=15886) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15898): Process ended prematurely: osmo-stp_10.42.42.5(pid=15898) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15898)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15908): Process ended prematurely: osmo-stp_10.42.42.5(pid=15908) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=15925): Process ended prematurely: osmo-stp_10.42.42.5(pid=15925) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=15937): Process ended prematurely: osmo-stp_10.42.42.5(pid=15937) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=15955): Process ended prematurely: osmo-stp_10.42.42.5(pid=15955) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=15968): Process ended prematurely: osmo-stp_10.42.42.5(pid=15968) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15968)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15978): Process ended prematurely: osmo-stp_10.42.42.5(pid=15978) [trial-2392↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15978)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=15992): Process ended prematurely: osmo-stp_10.42.42.5(pid=15992) [trial-2392↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15992)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16005): Process ended prematurely: osmo-stp_10.42.42.5(pid=16005) [trial-2392↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16005)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=16014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16014) [trial-2392↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16014)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16027): Process ended prematurely: osmo-stp_10.42.42.5(pid=16027) [trial-2392↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16027)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16041): Process ended prematurely: osmo-stp_10.42.42.5(pid=16041) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16041)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16052): Process ended prematurely: osmo-stp_10.42.42.5(pid=16052) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16052)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16066): Process ended prematurely: osmo-stp_10.42.42.5(pid=16066) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16066)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16077): Process ended prematurely: osmo-stp_10.42.42.5(pid=16077) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16102): Process ended prematurely: osmo-stp_10.42.42.5(pid=16102) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16116): Process ended prematurely: osmo-stp_10.42.42.5(pid=16116) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16116)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16127): Process ended prematurely: osmo-stp_10.42.42.5(pid=16127) [trial-2392↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16127)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16142): Process ended prematurely: osmo-stp_10.42.42.5(pid=16142) [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16142)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16154): Process ended prematurely: osmo-stp_10.42.42.5(pid=16154) [trial-2392↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16154)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16168): Process ended prematurely: osmo-stp_10.42.42.5(pid=16168) [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16179): Process ended prematurely: osmo-stp_10.42.42.5(pid=16179) [trial-2392↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16179)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16196): Process ended prematurely: osmo-stp_10.42.42.5(pid=16196) [trial-2392↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16196)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16207): Process ended prematurely: osmo-stp_10.42.42.5(pid=16207) [trial-2392↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16207)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=16226): Process ended prematurely: osmo-stp_10.42.42.5(pid=16226) [trial-2392↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16238): Process ended prematurely: osmo-stp_10.42.42.5(pid=16238) [trial-2392↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=16257): Process ended prematurely: osmo-stp_10.42.42.5(pid=16257) [trial-2392↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16267): Process ended prematurely: osmo-stp_10.42.42.5(pid=16267) [trial-2392↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16267)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16277): Process ended prematurely: osmo-stp_10.42.42.5(pid=16277) [trial-2392↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16277)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16294): Process ended prematurely: osmo-stp_10.42.42.5(pid=16294) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16294)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16306): Process ended prematurely: osmo-stp_10.42.42.5(pid=16306) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=16324): Process ended prematurely: osmo-stp_10.42.42.5(pid=16324) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16324)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16334): Process ended prematurely: osmo-stp_10.42.42.5(pid=16334) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16334)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16344): Process ended prematurely: osmo-stp_10.42.42.5(pid=16344) [trial-2392↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16344)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=16361): Process ended prematurely: osmo-stp_10.42.42.5(pid=16361) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16361)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16373): Process ended prematurely: osmo-stp_10.42.42.5(pid=16373) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=16391): Process ended prematurely: osmo-stp_10.42.42.5(pid=16391) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16391)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16401): Process ended prematurely: osmo-stp_10.42.42.5(pid=16401) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16401)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16411): Process ended prematurely: osmo-stp_10.42.42.5(pid=16411) [trial-2392↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16411)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=16433): Process ended prematurely: osmo-stp_10.42.42.5(pid=16433) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16433)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=16458): Process ended prematurely: osmo-stp_10.42.42.5(pid=16458) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] FAIL: iperf3m4.py (12.6 sec) Error: osmo-stp_10.42.42.5(pid=16735): Process ended prematurely: osmo-stp_10.42.42.5(pid=16735) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16735)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16746): Process ended prematurely: osmo-stp_10.42.42.5(pid=16746) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16746)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16756): Process ended prematurely: osmo-stp_10.42.42.5(pid=16756) [trial-2392↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16756)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16771): Process ended prematurely: osmo-stp_10.42.42.5(pid=16771) [trial-2392↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=16780): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16780) [trial-2392↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16780)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=16783): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16783) [trial-2392↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16783)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=16785): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16785) [trial-2392↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16785)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=16787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16787) [trial-2392↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16787)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=16799): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16799) [trial-2392↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16799)] FAIL: esme_connect_policy_closed.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=16810): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16810) [trial-2392↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16810)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16822): Process ended prematurely: osmo-stp_10.42.42.5(pid=16822) [trial-2392↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16822)] FAIL: esme_ms_sms_transaction.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16833): Process ended prematurely: osmo-stp_10.42.42.5(pid=16833) [trial-2392↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16833)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16847): Process ended prematurely: osmo-stp_10.42.42.5(pid=16847) [trial-2392↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16847)] FAIL: register_a5_0_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16858): Process ended prematurely: osmo-stp_10.42.42.5(pid=16858) [trial-2392↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16872): Process ended prematurely: osmo-stp_10.42.42.5(pid=16872) [trial-2392↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16883): Process ended prematurely: osmo-stp_10.42.42.5(pid=16883) [trial-2392↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16883)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.3 sec) Error: srsepc(pid=16903): Process ended prematurely: srsepc(pid=16903) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16903)] FAIL: iperf3_bidir.py (19.5 sec) Error: srsepc(pid=16919): Process ended prematurely: srsepc(pid=16919) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16919)] FAIL: iperf3_dl.py (19.2 sec) Error: srsepc(pid=16935): Process ended prematurely: srsepc(pid=16935) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16935)] FAIL: iperf3_ul.py (19.3 sec) Error: srsepc(pid=16951): Process ended prematurely: srsepc(pid=16951) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16951)] FAIL: ping.py (18.8 sec) Error: srsepc(pid=16969): Process ended prematurely: srsepc(pid=16969) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16969)] FAIL: rrc_idle_mo_ping.py (18.4 sec) Error: srsepc(pid=16985): Process ended prematurely: srsepc(pid=16985) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16985)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=17001): Process ended prematurely: srsepc(pid=17001) [trial-2392↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=17001)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17014): Process ended prematurely: osmo-stp_10.42.42.5(pid=17014) [trial-2392↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17014)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17030): Process ended prematurely: osmo-stp_10.42.42.5(pid=17030) [trial-2392↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17030)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17045): Process ended prematurely: osmo-stp_10.42.42.5(pid=17045) [trial-2392↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17045)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17060): Process ended prematurely: osmo-stp_10.42.42.5(pid=17060) [trial-2392↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17060)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17074): Process ended prematurely: osmo-stp_10.42.42.5(pid=17074) [trial-2392↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17088): Process ended prematurely: osmo-stp_10.42.42.5(pid=17088) [trial-2392↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17088)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17102): Process ended prematurely: osmo-stp_10.42.42.5(pid=17102) [trial-2392↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17102)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=17117): Process ended prematurely: osmo-stp_10.42.42.5(pid=17117) [trial-2392↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17117)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17134): Process ended prematurely: osmo-stp_10.42.42.5(pid=17134) [trial-2392↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17134)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17149): Process ended prematurely: osmo-stp_10.42.42.5(pid=17149) [trial-2392↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17149)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17163): Process ended prematurely: osmo-stp_10.42.42.5(pid=17163) [trial-2392↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17163)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17177): Process ended prematurely: osmo-stp_10.42.42.5(pid=17177) [trial-2392↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17177)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17191): Process ended prematurely: osmo-stp_10.42.42.5(pid=17191) [trial-2392↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17205): Process ended prematurely: osmo-stp_10.42.42.5(pid=17205) [trial-2392↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17219): Process ended prematurely: osmo-stp_10.42.42.5(pid=17219) [trial-2392↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17219)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17233): Process ended prematurely: osmo-stp_10.42.42.5(pid=17233) [trial-2392↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17233)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=17247): Process ended prematurely: osmo-stp_10.42.42.5(pid=17247) [trial-2392↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17247)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17261): Process ended prematurely: osmo-stp_10.42.42.5(pid=17261) [trial-2392↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17261)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17275): Process ended prematurely: osmo-stp_10.42.42.5(pid=17275) [trial-2392↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17275)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17290): Process ended prematurely: osmo-stp_10.42.42.5(pid=17290) [trial-2392↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17290)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17305): Process ended prematurely: osmo-stp_10.42.42.5(pid=17305) [trial-2392↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17305)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17319): Process ended prematurely: osmo-stp_10.42.42.5(pid=17319) [trial-2392↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17319)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17333): Process ended prematurely: osmo-stp_10.42.42.5(pid=17333) [trial-2392↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17333)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17348): Process ended prematurely: osmo-stp_10.42.42.5(pid=17348) [trial-2392↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17348)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17362): Process ended prematurely: osmo-stp_10.42.42.5(pid=17362) [trial-2392↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17376): Process ended prematurely: osmo-stp_10.42.42.5(pid=17376) [trial-2392↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17390): Process ended prematurely: osmo-stp_10.42.42.5(pid=17390) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17390)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17404): Process ended prematurely: osmo-stp_10.42.42.5(pid=17404) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17419): Process ended prematurely: osmo-stp_10.42.42.5(pid=17419) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17419)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2392↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=17447): Process ended prematurely: osmo-stp_10.42.42.5(pid=17447) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17447)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17461): Process ended prematurely: osmo-stp_10.42.42.5(pid=17461) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17475): Process ended prematurely: osmo-stp_10.42.42.5(pid=17475) [trial-2392↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17475)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17500): Process ended prematurely: osmo-stp_10.42.42.5(pid=17500) [trial-2392↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2392↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=18055): Process ended prematurely: osmo-stp_10.42.42.5(pid=18055) [trial-2392↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] + rm -rf trial-2392/inst + cd trial-2392 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 17:09:57 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392-run.tgz run.2022-12-13_17-10-08 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2392-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2986.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29305.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30089.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE